Papers with Information Retrieval
A Scalable Neural Shortlisting-Reranking Approach for Large-Scale Domain Classification in Natural Language Understanding (N18-3)
Copied to clipboard
| Challenge: | Existing approaches to classify a given utterance into domains are costly and time-consuming. |
| Approach: | They propose a shortlisting-reranking neural model for large-scale domain classification for IPDAs . they use extensive experiments on 1,500 IPDA domains to test their effectiveness . |
| Outcome: | The proposed model is tested on 1,500 IPDA domains. |
Know Your RAG: Dataset Taxonomy and Generation Strategies for Evaluating RAG Systems (2025.coling-industry)
Copied to clipboard
Rafael Teixeira de Lima, Shubham Gupta, Cesar Berrospi Ramis, Lokesh Mishra, Michele Dolfi, Peter Staar, Panagiotis Vagenas
| Challenge: | Retrieval Augmented Generation (RAG) systems are widespread in the industry. |
| Approach: | They propose to use Q&A datasets to assess retrieval performance and label-targeted data generation to refine RAG datasets. |
| Outcome: | The proposed system can generate Q&A datasets with fine-tuned small LLMs. |
Applying BERT to Document Retrieval with Birch (D19-3)
Copied to clipboard
| Challenge: | Birch is an open-source document retrieval system that integrates with the Anserini information retrieval toolkit to demonstrate end-to-end search over large document collections. |
| Approach: | They propose to integrate Anserini with a BERT-based document ranking model that provides an end-to-end open-source search engine. |
| Outcome: | The proposed system outperforms existing approaches to document retrieval and question answering on standard newswire and social media test collections. |
Joint Training for Learning Cross-lingual Embeddings with Sub-word Information without Parallel Corpora (2020.starsem-1)
Copied to clipboard
| Challenge: | Existing methods for learning cross-lingual word embeddings incorporate sub-word information during training. |
| Approach: | They propose a method that incorporates sub-word information during training to learn cross-lingual word embeddings from monolingual data and a bilingual lexicon. |
| Outcome: | The proposed method improves on bilingual lexicon induction, monolingual word similarity, and document classification using low-resource languages. |
Wikipedia as a Resource for Text Analysis and Retrieval (P19-4)
Copied to clipboard
| Challenge: | Tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
| Approach: | tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
| Outcome: | This tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
Bootstrapping Neural Relation and Explanation Classifiers (2023.acl-short)
Copied to clipboard
| Challenge: | supervised approaches that use only rules to explain the outputs of the relation classifier are data hungry and expensive to obtain. |
| Approach: | They propose a method that self trains (or bootstraps) neural relation and explanation classifiers by iterating the outputs into rules and applying them to unlabeled text to produce new annotations. |
| Outcome: | The proposed method outperforms the rule-based model on the TACRED dataset by 15 F1 points and performs comparatively with the prompt-based approach without an additional natural language inference component. |
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |
A Deep Learning-Based System for PharmaCoNER (D19-57)
Copied to clipboard
Ying Xiong, Yedan Shen, Yuanhang Huang, Shuai Chen, Buzhou Tang, Xiaolong Wang, Qingcai Chen, Jun Yan, Yi Zhou
| Challenge: | Efficient access to mentions of clinical entities is very important for using clinical text. |
| Approach: | They developed a pipeline system based on deep learning methods for this shared task . it achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average LSTM score of 0.8391 on track 2 . |
| Outcome: | The proposed system achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average score of 0.8391 on track 2. |
Doc-React: Multi-page Heterogeneous Document Question-answering (2025.acl-short)
Copied to clipboard
Junda Wu, Yu Xia, Tong Yu, Xiang Chen, Sai Sree Harsha, Akash V Maharaj, Ruiyi Zhang, Victor Bursztyn, Sungchul Kim, Ryan A. Rossi, Julian McAuley, Yunyao Li, Ritwik Sinha
| Challenge: | Existing methods for integrating information across multiple modalities are suboptimal for multi-page, multimodal documents. |
| Approach: | They propose an adaptive iterative framework that balances information gain and uncertainty reduction at each step. |
| Outcome: | The proposed framework captures relevant multimodal content and achieves strong performance on complex QA tasks. |
Aspect-based Analysis of Advertising Appeals for Search Engine Advertising (2022.naacl-industry)
Copied to clipboard
| Challenge: | ad creators must consider various aspects of advertising appeals such as price, product features, and quality in their ac work. |
| Approach: | They propose to use a dataset of ad texts to explore the effective aspects of advertising appeals (A3) for different industries to assist a search engine ap creators. |
| Outcome: | The proposed model can detect aspects of ad texts and help them estimate their performance. |
Improving Vietnamese-English Cross-Lingual Retrieval for Legal and General Domains (2025.naacl-short)
Copied to clipboard
Toan Ngoc Nguyen, Nam Le Hai, Nguyen Doan Hieu, Dai An Nguyen, Linh Ngo Van, Thien Huu Nguyen, Sang Dinh
| Challenge: | Existing document retrieval systems focus on a single language, targeting resource-rich languages like English or Chinese. |
| Approach: | They propose auxiliary loss function and symmetrical training strategy for cross-lingual retrieval between Vietnamese and English . they propose a dataset that covers the general domain and extends to the legal field . |
| Outcome: | The proposed dataset significantly improves state-of-the-art models on cross-lingual retrieval tasks. |
Enhancing Talent Search Ranking with Role-Aware Expert Mixtures and LLM-based Fine-Grained Job Descriptions (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing talent search approaches fail to capture nuanced job-specific preferences and mitigate noise from subjective human judgments. |
| Approach: | They propose a framework that extracts fine-grained recruitment signals from job descriptions and historical hiring data and employs a role-aware multi-gate MoE network to capture behavioral differences across recruiter roles. |
| Outcome: | The proposed framework improves talent search effectiveness and delivers substantial business value. |
QSpell 250K: A Large-Scale, Practical Dataset for Chinese Search Query Spell Correction (2025.naacl-industry)
Copied to clipboard
| Challenge: | Chinese Search Query Spell Correction is a task designed to identify and correct typographical errors within queries. |
| Approach: | They propose a large-scale benchmark specifically developed for Chinese Query Spell Correction. |
| Outcome: | The proposed benchmark covers a broad range of topics, including formal entities, everyday colloquialisms and idiomatic expressions. |
Detecting Heavy Rain Disaster from Social and Physical Sensor (C18-2)
Copied to clipboard
| Challenge: | Our system detects heavy rain disaster using social and physical sensors. |
| Approach: | They propose a system that detects heavy rain disaster by analyzing tweets and physical sensors. |
| Outcome: | The proposed system detects heavy rain disaster using social and physical sensors in Japan. |
Improving Retrieval-Augmented Generation without Taxonomy-based Error Categorization (2026.acl-short)
Copied to clipboard
| Challenge: | Recent work implicitly assumes reliable critic feedback and focuses on planning strategies, while paying limited attention to the robustness of the error correction process itself. |
| Approach: | They propose a response-action learning paradigm that maps flawed RAG outputs to error-mitigating action plans without explicit criticism. |
| Outcome: | The proposed model improves the factual accuracy of large language model outputs without explicit error categorization. |
FinBPM: A Framework for Portfolio Management-based Financial Investor Behavior Perception Model (2024.eacl-long)
Copied to clipboard
| Challenge: | a portfolio management framework based on reinforcement learning is needed to optimize stock price movements. |
| Approach: | They propose a framework that takes irrational investment into account when calculating portfolio weights . they use financial text to analyze intrinsic value information of companies and time series data . |
| Outcome: | The proposed framework gains 13.26% returns over state-of-the-art models while controlling for risk. |
Benchmarks and models for entity-oriented polarity detection (N18-3)
Copied to clipboard
| Challenge: | a dataset of 17,000 manually labeled documents is large for determining entity-oriented polarity in business news. |
| Approach: | They propose a convolutional neural network-based approach to classify entity-oriented polarity in business news. |
| Outcome: | The proposed model is based on convolutional neural networks and is small on the scale of existing models. |
DrugWatch: A Comprehensive Multi-Source Data Visualisation Platform for Drug Safety Information (2024.acl-demos)
Copied to clipboard
| Challenge: | Drug safety research is crucial for maintaining public health, but resources available to the public are limited. |
| Approach: | They propose an easy-to-use and interactive multi-source information visualisation platform for drug safety study. |
| Outcome: | The proposed platform provides a one-stop information analysis, retrieval, and annotation service. |
PEMV: Improving Spatial Distribution for Emotion Recognition in Conversations Using Proximal Emotion Mean Vectors (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing research focuses on the analysis of contextual structure in dialogue and the interactions between different emotions. |
| Approach: | They propose a method that generates Proximal Emotion Mean Vectors (PEMVs) based on emotion feature queues to optimize the spatial representation of text features. |
| Outcome: | The proposed method achieves state-of-the-art performance on three widely used benchmark datasets. |
Design Challenges for a Multi-Perspective Search Engine (2022.findings-naacl)
Copied to clipboard
| Challenge: | a document retrieval system fails to deliver diverse and direct responses to controversial questions . classical document retrievals provide a ranked list of references to relevant but not necessarily trustworthy web documents . |
| Approach: | They propose a perspective-oriented document retrieval paradigm to address these challenges . they propose sponses with different perspectives within topically-related web documents . |
| Outcome: | The proposed system is based on a user survey and a prototype . it will be used to assess the utility and understanding of the system . |
Label Representations in Modeling Classification as Text Generation (2020.aacl-srw)
Copied to clipboard
| Challenge: | Existing methods for text generation use strings to represent labels . linguistic properties of labels do affect performance, though their results are limited to document retrieval. |
| Approach: | They investigate the effect of string representations on how effectively a model learns a task . they use four standard text classification tasks to model string representation . |
| Outcome: | The proposed model improves on four standard text classification tasks . the results are largely negative in the low data setting . |
Lattice Path Edit Distance: A Romanization-aware Edit Distance for Extracting Misspelling-Correction Pairs from Japanese Search Query Logs (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to extract misspelling-correction pairs from Japanese query logs are not effective due to the unique input methods. |
| Approach: | They propose a romanization-aware edit distance that utilizes romanization lattices to efficiently consider all possible romanized forms of input strings. |
| Outcome: | Empirical results show lattice path edit distance outperforms standard edit distance in Japanese . latticae path editing distance outpersforms existing methods even with romanization . |
Trove: A Flexible Toolkit for Dense Retrieval (2026.eacl-demo)
Copied to clipboard
| Challenge: | Existing retrieval tools require considerable engineering effort for many tasks like efficient data management or model customization. |
| Approach: | They propose a novel open-source retrieval toolkit that simplifies research experiments without sacrificing flexibility or speed. |
| Outcome: | The proposed tool reduces memory consumption by 2.6 and allows for arbitrary customizations. |
Forged-GAN-BERT: Authorship Attribution for LLM-Generated Forged Novels (2024.eacl-srw)
Copied to clipboard
| Challenge: | generative Large Language Models (LLMs) are capable of producing human-like texts, but they pose challenges related to the authenticity of the text documents. |
| Approach: | They propose a modified GANBERT-based model to improve the classification of forged novels via the Forged Novels Generator and the generator in GAN. |
| Outcome: | The proposed model improves classification of forged novels in two data-augmentation aspects. |
Generate, Filter, and Rank: Grammaticality Classification for Production-Ready NLG Systems (N19-2)
Copied to clipboard
| Challenge: | Existing datasets for grammatical error correction don’t capture the distribution of errors that data-driven generators are likely to make. |
| Approach: | They propose a framework that allows candidates to be filtered and ranked to select the best response. |
| Outcome: | The proposed framework can be scaled with relatively low effort and achieve high precision with reasonable recall on a weather domain dataset. |
Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current Challenges (2023.eacl-demo)
Copied to clipboard
| Challenge: | Existing systems that retrieve trial publications matching a query are inefficient and introduce unsupported statements. |
| Approach: | They propose a system that aims to automatically summarize evidence presented in the set of randomized controlled trials most relevant to a given query. |
| Outcome: | The proposed system retrieves trial publications matching a query specifying a combination of condition, intervention(s), and outcome(s) and ranks them according to sample size and estimated study quality. |
Re3val: Reinforced and Reranked Generative Retrieval (2024.findings-eacl)
Copied to clipboard
| Challenge: | generative retrieval models encode pointers to information in a corpus as an index within the model’s parameters. |
| Approach: | They propose a generative retrieval model that leverages contextual information to rerank retrieved page titles and utilizes REINFORCE to maximize rewards generated by constrained decoding. |
| Outcome: | The proposed model can't be tuned for the downstream readers as decoding the page title is a non-differentiable operation. |
Fantastic Expressions and Where to Find Them: Chinese Simile Generation with Multiple Constraints (2023.acl-long)
Copied to clipboard
| Challenge: | Existing attempts to generate similes as context-free tasks are not suitable for simile generation . however, simile generated under such settings might be undesirable, we argue . |
| Approach: | They propose a model to generate a simile with multiple simile elements . they propose to use a vehicle retrieval module to obtain the explicable comparison . |
| Outcome: | The proposed model can generate a simile with multiple simile elements, e.g., context and vehicle. |
CMTA: COVID-19 Misinformation Multilingual Analysis on Twitter (2021.acl-srw)
Copied to clipboard
| Challenge: | myths, sensationalism, rumours and misinformation, generated intentionally or unintentionally, spread rapidly through social networks during the COVID-19 pandemic . evaluation of tweets for recognizing misinformation can create beneficial understanding to review the top quality and also the readability of online information concerning the COV-19. |
| Approach: | They propose a multilingual COVID-19 related tweet analysis method that uses a deep learning model for multilingual tweet misinformation detection and classification. |
| Outcome: | The proposed method outperforms monolingual models in the misinformation detection task and shows that it can be used to improve the quality and readability of online information. |
The ROOTS Search Tool: Data Transparency for LLMs (2023.acl-demo)
Copied to clipboard
Aleksandra Piktus, Christopher Akiki, Paulo Villegas, Hugo Laurençon, Gérard Dupont, Sasha Luccioni, Yacine Jernite, Anna Rogers
| Challenge: | a 1.6TB multilingual text corpus is currently the largest language model . large language models are ubiquitous in modern NLP, used directly to generate text and as building blocks in downstream applications. |
| Approach: | They propose a search engine for the 1.6TB multilingual ROOTS corpus offering both fuzzy and exact search capabilities. |
| Outcome: | The ROOTS Search Tool is an open-source search engine for the 1.6TB multilingual ROOTs corpus. |
IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review (2026.acl-long)
Copied to clipboard
| Challenge: | Scientific research relies on accurate information retrieval from literature to support analytical decisions. |
| Approach: | They propose a task that automates fine-grained information retrieval *faithfully* grounded in the provided content in response to research-driven queries. |
| Outcome: | The proposed agent achieves 13.2% higher cross-domain accuracy than state-of-the-art RAG and research-agent baselines across seven backbone LLMs. |
Question Decomposition for Retrieval-Augmented Generation (2025.acl-srw)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is effective for question answering tasks . multi-hop questions, such as "Which company among NVIDIA, Apple, and Google made the biggest profit in 2023?" challenge RAG because relevant facts are often distributed across multiple documents . |
| Approach: | They propose a pipeline that incorporates question decomposition to ground large language models in verifiable external sources. |
| Outcome: | The proposed approach improves retrieval and answer accuracy over standard RAG . multi-hop questions often require multiple documents to support the model . |
A Seed Corpus of Hindu Temples in India (2020.lrec-1)
Copied to clipboard
| Challenge: | a scientific study of temples can reveal valuable insights into culture and heritage of India. |
| Approach: | They propose a platform that creates temple corpus from web text on temples. |
| Outcome: | The proposed platform improves the curation of temple corpus using classifiers trained on Wikipedia articles on Hindu temples. |
Text Classification with Negative Supervision (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models for text representations have shown state-of-the-art performance on text classification tasks, however, the discrepancy between semantic similarity of texts and labelling standards affects classifiers. |
| Approach: | They propose a simple multitask learning model that uses negative supervision to generate distinct representations for texts with different labels. |
| Outcome: | The proposed model outperforms state-of-the-art models on classification tasks in three different languages. |
BERT Goes Off-Topic: Investigating the Domain Transfer Challenge using Genre Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained language models have improved performance of text classification tasks, but they still suffer from spurious domain-specific clues. |
| Approach: | They propose a method to augment pretrained language models by generating texts in any desired genre and on any desired topic. |
| Outcome: | The proposed method improves on genre classification tasks while showing no improvement for other topics. |
Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation (2021.acl-short)
Copied to clipboard
| Challenge: | Early fusion models with cross-attention have shown better-than-human performance on some question answer benchmarks, while it is a poor fit for retrieval since it prevents pre-computation of the answer representations. |
| Approach: | They propose a supervised data mining method to train an efficient late fusion retrieval model by using cross-attention models with cross-references. |
| Outcome: | The proposed model outperforms retrieval models trained with gold annotations on Precision at N (P@N) and Mean Reciprocal Rank (MRR). |
Questions Are All You Need to Train a Dense Passage Retriever (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing methods for dense retrieval require large supervised datasets with custom hard-negative mining and denoising of positive examples. |
| Approach: | They propose a new corpus-level autoencoding approach for training dense retrieval models that does not require labeled training data. |
| Outcome: | The proposed method matches or surpasses strong supervised performance levels on multiple QA benchmarks with no labeled training data or task-specific losses. |
NEST: Nested Evidence Survival for Retrieval (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation (RAG) rely on rigid heuristics or computational overhead. |
| Approach: | They propose a lightweight, training-free RAG framework that separates recall amplification from precision selection. |
| Outcome: | Evaluated on WebQuestions, HotpotQA and internalQA benchmarks, NEST outperforms strong adaptive RAG baselines. |
Similarity Measures for the Detection of Clinical Conditions with Verbal Fluency Tasks (N18-2)
Copied to clipboard
| Challenge: | Semantic Verbal Fluency tests have been used in the diagnosis of certain clinical conditions, like Dementia. |
| Approach: | They investigate three similarity measures for automatically identifying switches in semantic chains: semantic similarity from a manually constructed resource, word association strength and semantic relatedness, both calculated from corpora. |
| Outcome: | The proposed classifiers outperform those that use a gold standard taxonomy for clinical conditions. |
R2A-TLS: Reflective Retrieval-Augmented Timeline Summarization with Causal-Semantic Integration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture coherent event narratives due to fragmented descriptions . Existing approaches accumulate noise through iterative retrieval strategies that lack relevance evaluation. |
| Approach: | They propose a reflective retrieval-augmented timeline summarization with Causal-Semantic Intergration approach for open-domain timeline summarizing . |
| Outcome: | The proposed approach outperforms the best prior published approaches. |
Descriptive Knowledge Graph in Biomedical Domain (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Existing systems that retrieve unconnected passages do not provide efficient search for relational knowledge. |
| Approach: | They propose a system that automatically extracts and generates informative and descriptive sentences from the biomedical corpus and facilitates efficient search for relational knowledge. |
| Outcome: | The proposed system extracts and generates informative and descriptive sentences from the biomedical corpus and facilitates the efficient search for relational knowledge. |
Coarse2Fine: Fine-grained Text Classification on Coarsely-grained Annotated Data (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing text classification methods focus on a fixed label set, but many real-world applications require extending to new fine-grained classes as the number of samples per label increases. |
| Approach: | They propose a problem called coarse-to-fine grained classification that leverages label surface names as the only human guidance. |
| Outcome: | The proposed method outperforms existing methods on two real-world datasets. |
Text2Mol: Cross-Modal Molecule Retrieval with Natural Language Queries (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing databases contain tens of millions of molecules; PubChem alone has 110 million compounds. |
| Approach: | They propose a task to retrieve molecules using natural language descriptions as queries . they construct a paired dataset of molecules and their corresponding text descriptions . |
| Outcome: | The proposed approach improves results from 0.372 to 0.499 MRR. |
AIDA-SEAT: Towards Reliable AI Doctor Assistant via State-Evaluation-Action Tree Enhanced LLMs in Online Hospital (2026.acl-industry)
Copied to clipboard
Lianxin Sun, Xiaoying Ying, Guangya Yu, Weiyan Zhang, Chenhao Guan, Hao He, Mingxi Shang, Jianhua Li, ChunMing Wang, Tong Ruan
| Challenge: | Existing systems rely on large language models or retrieval-augmented generation (RAG) but these methods lack the explicit logical pathways essential for multi-step reasoning. |
| Approach: | They propose an AIDA-SEAT framework to provide reliable clinical decision-making support by transforming and modifying medical documents and doctors' state-evaluation-action trees. |
| Outcome: | The proposed framework achieves 1.01% higher than current state-of-the-art (SOTA) baselines across five departments, including common RAG-based methods. |
SLARD: A Chinese Superior Legal Article Retrieval Dataset (2025.coling-main)
Copied to clipboard
| Challenge: | Existing retrieval methods struggle to achieve ideal results, a study finds . existing large language models lack prior knowledge of the content of superior legal articles . |
| Approach: | They propose to use a Chinese superior legal article retrieval dataset to find relevant articles with higher legal effectiveness. |
| Outcome: | The proposed dataset shows that existing retrieval methods struggle to achieve ideal results. |
Integrating Plutchik’s Theory with Mixture of Experts for Enhancing Emotion Classification (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for emotion classification ignore the sentimental aspects of text, resulting in a lack of generalization and sampling bias. |
| Approach: | They propose a method for emotion classification using Plutchik’s Wheel of Emotions theory and a Mixture of Experts architecture to evaluate the effectiveness. |
| Outcome: | The proposed method improves the performance of emotion classification. |
Regression-Free Model Updates for Spoken Language Understanding (2023.acl-industry)
Copied to clipboard
| Challenge: | Recent work has proposed methods for minimizing regressions caused by model updates . focus is on spoken language understanding models, which are unexplored . |
| Approach: | They propose a focal distillation technique to reduce regressions in goal-oriented dialog systems . they also evaluate its effectiveness for key language understanding tasks . |
| Outcome: | The proposed technique outperforms naive supervised training in mislabeled data and label expansion settings. |
Modeling Local Contexts for Joint Dialogue Act Recognition and Sentiment Classification with Bi-channel Dynamic Convolutions (2020.coling-main)
Copied to clipboard
| Challenge: | a novel context-aware dynamic convolution network is proposed to better leverage the local contexts when dynamically generating convolution kernels. |
| Approach: | They propose a dynamic convolution network to leverage local contexts when generating convolution kernels. |
| Outcome: | The proposed frameworks achieve state-of-the-art on two benchmark datasets. |
AutoIntent: AutoML for Text Classification (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing solutions for text classification tasks lack comprehensive support for hyperparameter optimization. |
| Approach: | They propose to automate text classification tasks using a modular, sklearn-like interface. |
| Outcome: | The proposed framework shows superior performance on intent classification datasets and enables users to balance effectiveness and resource consumption. |
Adaptive Document Retrieval for Deep Question Answering (D18-1)
Copied to clipboard
| Challenge: | Existing methods for deep question answering do not understand the exact interplay between document retrieval and machine comprehension. |
| Approach: | They propose an adaptive document retrieval model that learns the optimal document number, conditional on the size of the corpus and the query. |
| Outcome: | The proposed model outperforms state-of-the-art methods on multiple benchmark datasets and in the context of corpora with variable sizes. |
Semantic alignment in hyperbolic space for fine-grained emotion classification (2025.acl-srw)
Copied to clipboard
| Challenge: | Existing approaches to fine-grained emotion classification operate in Euclidean space, where the flat geometry makes it difficult to distinguish semantically similar label labels. |
| Approach: | They propose a semantic alignment framework that leverages the Lorentz model of hyperbolic space to embed text and label representations into hyperbolical space via the exponential map. |
| Outcome: | The proposed framework improves on two benchmark FEC datasets. |
Relevance-guided Supervision for OpenQA with ColBERT (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent work has focused on learning to retrieve passages for open-domain question answering . if notions of relevance are not tailored to questions, the MRC model will not reliably see the best passages . |
| Approach: | They propose a retrieval model that uses coarse-grained vector representations of questions and passages to adapt it to OpenQA. |
| Outcome: | The proposed system improves OpenQA retrieval on Natural Questions, SQuAD, and TriviaQA. |
D3: Dynamic Docid Decoding for Multi-Intent Generative Retrieval (2026.eacl-industry)
Copied to clipboard
| Challenge: | Existing GR systems rely on offline DocID assignment and constrained decoding . offline Doc ID assignment and decoding often prevents GR from capturing query-specific intent . |
| Approach: | They propose a mechanism that adaptively refines DocIDs through query-informed identifier expansion. |
| Outcome: | The proposed mechanism improves retrieval accuracy on unseen and multi-intent documents. |
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation (2024.acl-long)
Copied to clipboard
Kun Zhu, Xiaocheng Feng, Xiyuan Du, Yuxuan Gu, Weijiang Yu, Haotian Wang, Qianglong Chen, Zheng Chu, Jingchang Chen, Bing Qin
| Challenge: | Experimental results show that retrieval-augmented generation improves accuracy and relevance of large language models. |
| Approach: | They propose to introduce the information bottleneck theory into retrieval-augmented generation by maximizing mutual information between compression and ground output while minimizing mutual information . |
| Outcome: | The proposed approach improves accuracy and correctness of answer generation and conciseness with 2.5% compression rate. |
Operational Advice for Dense and Sparse Retrievers: HNSW, Flat, or Inverted Indexes? (2025.acl-industry)
Copied to clipboard
| Challenge: | Currently, practitioners working on dense retrieval face a bewildering number of choices. |
| Approach: | They propose a framework for thinking about retrieval in terms of nearest-neighbor search over vector representations where these representations can be dense (typically called embeddings, generated from transformers) or flat (with brute-force search) |
| Outcome: | The proposed model explicates tradeoffs between HNSW and flat indexes from the perspectives of indexing time, query evaluation performance, and retrieval quality. |
Bridging Cultures in the Kitchen: A Framework and Benchmark for Cross-Cultural Recipe Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Adapting recipes to cultural differences presents significant importance and challenges . bridging cultural differences is a challenge, but IR can help. |
| Approach: | They propose a framework that preserves the original recipe and its cultural appropriateness for the target culture. |
| Outcome: | The proposed framework preserves the original recipe and its cultural appropriateness for the target culture while maintaining relevance to the original. |
BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work adopts separate modules for retrieval and generation, which may be suboptimal since the retrieval task and generation task cannot benefit from each other to improve performance. |
| Approach: | They propose a backbone-shared RAG framework that uses a domain-specific corpus to continuously pre-train a model and then trains two plug-and-play Low-Rank Adaptation modules based on the shared backbone to minimize retrieval and generation losses respectively. |
| Outcome: | The proposed framework outperforms baseline models by 5% and 13% in Hit@3 upon two datasets in retrieval evaluation and by 23% in terms of BLEU-3 in generation evaluation. |
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them (2021.tacl-1)
Copied to clipboard
Patrick Lewis, Yuxiang Wu, Linqing Liu, Pasquale Minervini, Heinrich Küttler, Aleksandra Piktus, Pontus Stenetorp, Sebastian Riedel
| Challenge: | Open-domain Question Answering models that directly leverage question-answer (QA) pairs show promise in terms of speed and memory compared with conventional models which retrieve and read from text corpora. |
| Approach: | They propose a question-answer (QA)-pair retriever to facilitate improved QA-patch models by introducing Probably Asked Questions (PAQ) they propose QA pair retriever, RePAQ, which preempts and caches test questions, enabling it to match the accuracy of recent retrieve-and-read models, whilst being significantly faster. |
| Outcome: | The proposed model outperforms baseline models by 5% but trails RePAQ by 15% . it can be configured for size (under 500MB) or speed (over 1K questions per second) while retaining high accuracy. |
Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language Learning (2023.eacl-main)
Copied to clipboard
| Challenge: | Continual learning (CL) is a fundamental requirement for human-like general intelligence (Parisi et al., 2019). |
| Approach: | They propose to control sample generation using compressed features of previous training samples by using hippocampal memory indexing to enhance the generative replay. |
| Outcome: | The proposed method outperforms current generative replay methods and generates training samples from previous tasks. |
Exploring Optimism and Pessimism in Twitter Using Deep Learning (D18-1)
Copied to clipboard
| Challenge: | Identifying optimistic and pessimistic viewpoints and users from Twitter is useful for providing better social support to those who need it. |
| Approach: | They propose deep learning models to predict optimism and pessimism in Twitter . they also show that a sentiment classifier would not be sufficient for predicting optimism and psi . |
| Outcome: | The proposed models outperform traditional machine learning classifiers on optimism and pessimism in Twitter. |
AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework (2024.lrec-main)
Copied to clipboard
| Challenge: | Currently, ML&DL methods fail to provide reasons for stock trend predictions, lacking interpretability and reasoning processes. large language models (LLMs) suffer from hallucinations and are unable to keep up with the latest information. |
| Approach: | They develop a method to train large language models to handle financial analysis tasks . they use AlphaFin datasets to compare performance with traditional methods . |
| Outcome: | The proposed method improves stock trend prediction and financial question answering tasks. |
Potential Idiomatic Expression (PIE)-English: Corpus for Classes of Idioms (2022.lrec-1)
Copied to clipboard
Tosin Adewumi, Roshanak Vadoodi, Aparajita Tripathy, Konstantina Nikolaido, Foteini Liwicki, Marcus Liwicki
| Challenge: | Potential Idiomatic Expression (PIE) dataset for NLP in English contains over 20,100 samples with almost 1,200 cases of idioms from 10 classes (or senses). |
| Approach: | They present a large Potential Idiomatic Expression (PIE) dataset for Natural Language Processing (NLP) in English. |
| Outcome: | The proposed dataset contains over 20,100 samples with almost 1,200 cases of idioms (with their meanings) from 10 classes (or senses). |
Adaptive Hyper-parameter Learning for Deep Semantic Retrieval (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for deep semantic retrieval are highly sensitive to hyper-parameters . a novel adaptive metric learning method is proposed to overcome this limitation . |
| Approach: | They propose a method that adaptively obtains hyper-parameters without fixed or extra-trainable hyper-parmeters . they adopt a symmetric metric learning method to mitigate model collapse issues . |
| Outcome: | The proposed method outperforms existing methods on a real-world dataset and brings economic benefits. |
Logic Matters in Lightweight Hallucination Classification for RAG System (2026.acl-long)
Copied to clipboard
| Challenge: | Existing hallucination detection frameworks for RAGs lack robustness and performance . a compact model may lose track of precise information in retrieved segments or misinterpret a document's entailment score. |
| Approach: | They propose a lightweight, modular framework for hallucination detection in RAG systems . they capture logical relationships among retrieved documents within the vector space . |
| Outcome: | The proposed framework improves hallucination detection in RAG systems without complex architectures or pre-training on datasets. |
REIC: RAG-Enhanced Intent Classification at Scale (2025.emnlp-industry)
Copied to clipboard
Ziji Zhang, Michael Yang, Zhiyu Chen, Yingying Zhuang, Shu-Ting Pi, Qun Liu, Rajashekar Maragoud, Vy Nguyen, Anurag Beniwal
| Challenge: | Accurate intent classification is critical for efficient routing in customer service . however, as companies expand their product lines, intent classification faces scalability challenges . |
| Approach: | They propose a retrieval-augmented generation Enhanced Intent Classification approach which leverages retrieval augmented generation to integrate relevant knowledge into a model. |
| Outcome: | The proposed approach outperforms fine-tuning, zero-shot, and few-shot methods on real-world datasets. |
The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detection (2025.findings-naacl)
Copied to clipboard
Tomáš Horych, Christoph Mandl, Terry Ruas, Andre Greiner-Petter, Bela Gipp, Akiko Aizawa, Timo Spinde
| Challenge: | Recent research suggests using Large Language Models (LLMs) to automate the annotation process, reducing these costs while maintaining data quality. |
| Approach: | They propose to use Large Language Models to automate annotation process and train classifiers on large datasets. |
| Outcome: | The proposed model outperforms all of the annotator LLMs on two media bias benchmark datasets (BABE and BASIL) while maintaining data quality. |
An Empirical Comparison of Instance Attribution Methods for NLP (2021.naacl-main)
Copied to clipboard
| Challenge: | Influence functions provide machinery for identifying training instances that may have led to a specific prediction, but are computationally expensive and prohibitive in many cases. |
| Approach: | They evaluate the degree to which different potential instance attribution agrees with respect to the importance of training samples. |
| Outcome: | The proposed methods exhibit desirable characteristics similar to more complex methods, but are computationally expensive. |
Learning to Paraphrase Sentences to Different Complexity Levels (2023.tacl-1)
Copied to clipboard
| Challenge: | Using unsupervised datasets, we train models on sentence complexification and same-level paraphrasing tasks. |
| Approach: | They compare two unsupervised datasets with a single supervised dataset to train models on sentence complexification and same-level paraphrasing tasks. |
| Outcome: | The proposed models outperform previous work on sentence-level targeting and improve on the ASSET simplification benchmark. |
Open Political Corpora: Structuring, Searching, and Analyzing Political Text Collections with PoliCorp (2025.emnlp-demos)
Copied to clipboard
| Challenge: | PoliCorp provides researchers with access to rich textual data, enabling in-depth analysis of parliamentary discourse over time. |
| Approach: | They present a web portal that allows researchers to search political text corpora . the platform currently contains a collection of transcripts from the german parliament . |
| Outcome: | The proposed platform provides researchers with access to rich textual data, enabling in-depth analysis of parliamentary discourse over time. |
Exploring Knowledge Filtering for Retrieval-Augmented Discriminative Tasks (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on generative tasks, while its potential in discriminative tasks remains largely unexplored. |
| Approach: | They propose a framework that incorporates knowledge filtering and prediction fusion mechanisms to improve model performance. |
| Outcome: | The proposed framework improves model performance on discriminative tasks by filtering out harmful knowledge and integrating it into the input context. |
A Semi-supervised Scalable Unified Framework for E-commerce Query Classification (2025.acl-industry)
Copied to clipboard
Chunyuan Yuan, Chong Zhang, Zhen Fang, Ming Pang, Xue Jiang, Changping Peng, Zhangang Lin, Ching Law
| Challenge: | Existing query classification methods rely on posterior click behavior to construct training samples, resulting in insufficient prior information for modeling. |
| Approach: | They propose a semi-supervised scaleable unified framework that integrates enhanced modules to unify query classification tasks. |
| Outcome: | The proposed framework outperforms the state-of-the-art models in offline and online A/B experiments. |
LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights cases (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches overlook the underlying semantic intent in determining relevance with respect to a query case. |
| Approach: | They propose a method that generates intents in the form of legal concepts from a query case facts and then augments the query with these concepts to enhance models understanding of semantic intent. |
| Outcome: | The proposed approach generates intents in the form of legal concepts and augments the query with these concepts to enhance models understanding of semantic intent that dictates relavance. |
WatClaimCheck: A new Dataset for Claim Entailment and Inference (2022.acl-long)
Copied to clipboard
| Challenge: | a dataset for automated fact checking is presented . premise articles are used to verify the veracity of claims . |
| Approach: | They propose a dataset for automated fact checking and an evaluation of state of the art algorithms. |
| Outcome: | The proposed model improves retrieval quality of passages in premise articles . the proposed model predicts claim veracity by inference from premise article . |
Optimizing Retrieval-augmented Reader Models via Token Elimination (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for ODQA use a retrieval-augmented language model . a generative model can cause a significant bottleneck in decoding time . |
| Approach: | They propose to eliminate some of the retrieved information that might not contribute essential information to the answer generation process. |
| Outcome: | The proposed method reduces run-time by up to 62.2% with only 2% reduction in performance and improves performance. |
End-to-End Beam Retrieval for Multi-Hop Question Answering (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing beam retrieval frameworks for multi-hop question answering were customized for two-hop questions and were poorly supervised. |
| Approach: | They propose an end-to-end beam retrieval framework for multi-hop question answering . they combine an encoder and two classification heads to optimize the retrieval process . |
| Outcome: | The proposed framework improves on MuSiQue-Ans and surpasses all previous retrievers on HotpotQA and achieves 99.9% precision on 2WikiMultiHopQA. |
DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management (2025.findings-emnlp)
Copied to clipboard
Kai Yin, Xiangjue Dong, Chengkai Liu, Lipai Huang, Yiming Xiao, Zhewei Liu, Ali Mostafavi, James Caverlee
| Challenge: | Existing information retrieval benchmarks focus on general or specialized domains, such as medicine or finance, neglecting the unique linguistic complexity and diverse information needs encountered in disaster management scenarios. |
| Approach: | DisastIR is the first comprehensive IR evaluation benchmark specifically tailored for disaster management. |
| Outcome: | DisastIR covers 48 retrieval tasks derived from six search intents and eight general disaster categories . evaluations show no single model excelling universally . |
Survival text regression for time-to-event prediction in conversations (2021.findings-acl)
Copied to clipboard
| Challenge: | a recent study has modelled time-to-event prediction tasks as classification tasks . authors: this is contrived and less informative than traditional classification models . |
| Approach: | They propose to frame time-to-event prediction tasks as classification tasks . they use survival regression techniques commonly used in healthcare and reliability engineering . |
| Outcome: | The proposed models outperform text regression methods and comparable classification models on three datasets. |
Text Categorization by Learning Predominant Sense of Words as Auxiliary Task (P19-1)
Copied to clipboard
| Challenge: | Existing methods for text categorization use implicit representations to learn the senses of words. |
| Approach: | They propose a method for text categorization by leveraging the predominant sense of words depending on the domain. |
| Outcome: | The proposed model improves performance on four benchmark datasets. |
Culinary Crossroads: A RAG Framework for Enhancing Diversity in Cross-Cultural Recipe Adaptation (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a promising approach for cross-cultural recipe adaptation, but it fails to generate diverse results even when provided with varied contextual inputs. |
| Approach: | They propose a plug-and-play RAG framework that enhances diversity in both retrieval and context organization to generate diverse outputs to accommodate multiple user preferences. |
| Outcome: | The proposed framework achieves Pareto efficiency in terms of diversity and quality of recipe adaptation compared to closed-book LLMs. |
Bidirectional Reasoning Supervision for Multilingual Financial Decision Making (2025.emnlp-industry)
Copied to clipboard
Muhammad Rafsan Kabir, Jawad Ibn Ahad, Robin Krambroeckers, Silvia Ahmed, M M Lutfe Elahi, Nabeel Mohammed, Shafin Rahman
| Challenge: | Large Language Models have been used for sentiment analysis, machine translation, and question answering, but their effectiveness in the multilingual financial domain remains unknown. |
| Approach: | They propose a fine-tuning approach that integrates positive and negative rationales alongside classification labels. |
| Outcome: | The proposed approach outperforms existing methods across English, Hindi, Bengali, and Telugu, and is suitable for industry applications. |
Is Semantic Chunking Worth the Computational Cost? (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances in Retrieval-Augmented Generation (RAG) systems have popularized semantic chunking. |
| Approach: | They evaluate the effectiveness of semantic chunking using three common retrieval tasks . they find that the computational costs associated with semantic chunks are not justified by consistent performance gains. |
| Outcome: | The proposed semantic chunking approach is not able to deliver consistent performance gains in three retrieval-related tasks. |
Aegis:An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Aegis is an advanced LLM-based multi-agent for intelligent functional safety engineering that can perform all phases of a vehicle's lifecycle, including design, development, production, operation, and decommissioning. |
| Approach: | They introduce Aegis: An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering. |
| Outcome: | The proposed solution can perform Hazard Analysis and Risk Assessment (HARA), document Functional Safety Requirements (FSR), and plan test cases for Automatic Emergency Braking (AEB) systems. |
Improving Informally Romanized Language Identification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Latin script is often used to informally write languages with non-Latin native scripts, resulting in high spelling variability. |
| Approach: | They propose to improve methods used to synthesize training sets to incorporate natural spelling variations into training sets. |
| Outcome: | The proposed method improves test F1 from the reported 74.7% (using a pretrained neural model) to 85.4% (using the linear classifier trained solely on synthetic data). |
Query-as-context Pre-training for Dense Passage Retrieval (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve passage retrieval performance by using context-supervised pre-training are weakly correlated. |
| Approach: | They propose to use query-as-context pre-training to train passage-query pairs . they evaluate the pre-trained models on large-scale passage retrieval benchmarks . |
| Outcome: | The proposed technique improves performance on large-scale passage retrieval benchmarks and out-of-domain zero-shot benchmarks. |
Cross-media User Profiling with Joint Textual and Social User Embedding (C18-1)
Copied to clipboard
| Challenge: | Empirical studies demonstrate the effectiveness of the proposed approach to cross-media user profiling tasks. |
| Approach: | They propose a uniform user embedding learning approach to address cross-media user profiling by bridging the knowledge between the source and target media. |
| Outcome: | Empirical results show that the proposed approach performs well on two cross-media user profiling tasks. |
LLM-based Conversational Recommendation Agents with Collaborative Verbalized Experience (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive zero-shot capabilities in conversational recommender systems (CRS). |
| Approach: | They propose LLM-based CRS-based LLMs with Collaborative Verbalized Experience to enhance historical conversations by sampling trajectories of LLM agents on historical queries and establishing verbalized experience banks . |
| Outcome: | The proposed system improves on existing approaches to enhancing historical conversations by leveraging trajectories and verbalized experiences from LLMs on historical queries and user feedback. |
AWARE: Agentic Knowledge Warehousing for Contextual Intelligence (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models excel in information seeking tasks, but their knowledge is limited in coverage and timeliness. |
| Approach: | They propose an agentic knowledge warehousing framework that transforms unstructured data into minimal, task-conditioned knowledge representations consumable by LLMs. |
| Outcome: | Experiments on GAIA, WebWalker, and BrowseComp-Plus show improvements over baselines. |
Efficient, Uncertainty-based Moderation of Neural Networks Text Classifiers (2022.findings-acl)
Copied to clipboard
| Challenge: | A series of benchmarking experiments based on three different datasets and three state-of-the-art classifiers show that our framework can improve the classification F1-scores by 5.1 to 11.2% (up to approx. 98 to 99%) |
| Approach: | They propose a semi-automated approach that passes unconfident, probably incorrect classifications to human moderators to minimize the workload. |
| Outcome: | The proposed approach can improve the classification F1-scores by 5.1 to 11.2% (up to approx. 98 to 99%) while reducing the moderation load up to 73.3% compared to a random moderation. |
Modeling Noisiness to Recognize Named Entities using Multitask Neural Networks on Social Media (N18-1)
Copied to clipboard
| Challenge: | Current approaches to Named Entity Recognition (NER) are effective in formal text, but they fail on informal text, where improper grammatical structures, spelling inconsistencies, and slang vocabulary prevail. |
| Approach: | They propose a multitask end-to-end bidirectional long short-term memory (BLSTM)-Conditional Random Field (CRF) network with two CRF classifiers and a feature extractor that transfers learning to a CRF for prediction. |
| Outcome: | The proposed models outperform the current state-of-the-art on the Workshop on Noisy User-generated Text 2017 dataset by 2.45% and 3.69%, establishing a more suitable approach for social media environments. |
No Simple Answer to Data Complexity: An Examination of Instance-Level Complexity Metrics for Classification Tasks (2025.naacl-long)
Copied to clipboard
| Challenge: | Understanding data complexity at the instance level has become increasingly important in Natural Language Processing (NLP) and machine learning (ML). |
| Approach: | They empirically examine the relationship between instance-level complexity scores and metric selection for classification tasks. |
| Outcome: | The results show that storing training loss provides similar complexity rankings to other methods, but not demographic fairness, even in downstream predictions. |
MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Chia-Yuan Chang, Zhimeng Jiang, Vineeth Rakesh, Menghai Pan, Chin-Chia Michael Yeh, Guanchu Wang, Mingzhi Hu, Zhichao Xu, Yan Zheng, Mahashweta Das, Na Zou
| Challenge: | Existing RAG systems struggle with the quality of retrieval documents, causing performance degradation and reducing performance. |
| Approach: | They propose a training-free RAG framework that leverages multiple LLM agents to collaboratively filter and score retrieved documents. |
| Outcome: | The proposed framework outperforms existing RAG frameworks in QA benchmarks and shows superior answer consistency and answer accuracy over baseline methods. |
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction (D19-1)
Copied to clipboard
Stefan Larson, Anish Mahendran, Joseph J. Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K. Kummerfeld, Kevin Leach, Michael A. Laurenzano, Lingjia Tang, Jason Mars
| Challenge: | Task-oriented dialog systems need to know when a query falls outside their range of supported intents. |
| Approach: | They propose a dataset that includes queries that are out-of-scope and 150 intent classes over 10 domains. |
| Outcome: | The proposed dataset includes queries that are out-of-scope, i.e., queries that do not fall into any of the system’s supported intents. |
Adaptive Contrastive Decoding in Retrieval-Augmented Generation for Handling Noisy Contexts (2024.findings-emnlp)
Copied to clipboard
Youna Kim, Hyuhng Joon Kim, Cheonbok Park, Choonghyun Park, Hyunsoo Cho, Junyeob Kim, Kang Min Yoo, Sang-goo Lee, Taeuk Kim
| Challenge: | Recent research has been developed to amplify contextual knowledge over parametric knowledge of large language models (LLMs) in knowledge-intensive tasks such as open-domain question-answering . |
| Approach: | They propose to amplify contextual knowledge over parametric knowledge of large language models (LLMs) by contrastive decoding to leverage contextual influence effectively. |
| Outcome: | The proposed approach improves open-domain question answering tasks especially in robustness by remaining undistracted by noisy contexts in retrieval-augmented generation. |
An Element is Worth a Thousand Words: Enhancing Legal Case Retrieval by Incorporating Legal Elements (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for legal case retrieval lack the definition of relevance for legal cases . however, the definition goes beyond the common semantic relevance of ad-hoc retrieval. |
| Approach: | They propose a legal element dataset that incorporates legal elements into a semi-automatic method . they propose two models to enhance legal search using legal elements . |
| Outcome: | The proposed models outperform existing methods in enhancing legal search using legal elements. |
MatRank: Text Re-ranking by Latent Preference Matrix (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text ranking have improved performance, but there are still challenges. |
| Approach: | They propose a method that learns to re-rank the text retrieved for a given query by learning to predict the most relevant passage based on a latent preference matrix. |
| Outcome: | The proposed method outperforms all prior methods on datasets with extensive results. |
Learning to Retrieve Engaging Follow-Up Queries (2023.findings-eacl)
Copied to clipboard
Christopher Richardson, Sudipta Kar, Anjishnu Kumar, Anand Ramachandran, Zeynab Raeesy, Omar Khan, Abhinav Sethy
| Challenge: | Open domain conversational agents can answer a wide range of targeted queries, but knowledge exploration is a lengthy task. |
| Approach: | They propose a retrieval based system for predicting the next questions that the user might have . they train ranking models on a dataset called the Follow-up Query Bank . |
| Outcome: | The proposed system can proactively assist users in knowledge exploration leading to a more engaging dialog. |
DRAFT: Dense Retrieval Augmented Few-shot Topic classifier Framework (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for few-shot topic classification are limited due to the volume of information pouring in from the Internet . a new framework is proposed to train a classifier for few shot topics . |
| Approach: | They propose a framework to train a classifier for few-shot topic classification using a customized dataset and a dense retriever model. |
| Outcome: | The proposed framework shows superior performance on few-shot topic classification tasks compared to baselines that use in-context learning . |
MAPS: Motivation-Aware Personalized Search via LLM-Driven Consultation Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing personalized product search methods assume that users’ query fully captures their real motivation, but in practice, user's queries do not always articulate the requirements. |
| Approach: | They propose a Motivation-Aware Personalized Search method that embeds queries and consultations into a unified semantic space via LLMs and utilizes a Mixture of Attention Experts (MoAE) to prioritize critical semantics. |
| Outcome: | Extensive experiments on real and synthetic data show that the proposed method outperforms existing methods in retrieval and ranking tasks. |
BoolQuestions: Does Dense Retrieval Understand Boolean Logic in Language? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Dense retrieval systems focus on optimizing text embedding space while overlooking Boolean logic in language. |
| Approach: | They propose a task to investigate whether retrieval systems can comprehend Boolean logic in language. |
| Outcome: | The proposed method is based on a benchmark dataset covering complex queries containing basic Boolean logic and corresponding annotated passages. |
ICLER: Intent CLassification with Enhanced Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for intent classification are inadequate in identifying micro-grained intentions . ICLER is based on In-Context Learning, but it is inadequate in enterprise vertical domains . |
| Approach: | They propose an intent classification method with enhanced reasoning that optimizes the embedding model to capture subtle sentence-level information. |
| Outcome: | The proposed method outperforms existing methods in intent identification tasks in vertical domains. |
ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models overlook the temporal dimension in their training process, leading to suboptimal performance over time. |
| Approach: | They propose a training paradigm that trains models on chronological splits, preserving the temporal order of the data. |
| Outcome: | The proposed model fails to fit to recent data, despite continual learning and temporal invariant methods. |
Collaborative Chain-of-Agents for Parametric-Retrieved Knowledge Synergy (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RAG methods focus on external retrieval, while ignoring the rich content of the model. |
| Approach: | They propose a framework that enhances explicit synergy over parametric and retrieved knowledge by integrating external retrieval components into the input context of the LLMs. |
| Outcome: | The proposed framework enhances explicit synergy over parametric and retrieved knowledge. |
In-Context Example Ordering Guided by Label Distributions (2024.findings-naacl)
Copied to clipboard
| Challenge: | Prior work has shown that ICL is sensitive to different natural language instructions and different orderings of in-context examples. |
| Approach: | They propose two principles for in-context example ordering guided by model’s probability predictions. |
| Outcome: | The proposed model outperforms baseline models on 13 text classification datasets and nine autoregressive LLMs with 700M to 13B parameters. |
UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) has shown substantial promise in improving factual accuracy by grounding model responses with external knowledge relevant to queries. |
| Approach: | They propose a framework to retrieve and integrate knowledge from heterogeneous sources with diverse modalities and granularities. |
| Outcome: | The proposed framework shows superiority over existing methods on 10 benchmarks of multiple modalities. |
A Compliance Checking Framework Based on Retrieval Augmented Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing text-based compliance checking methods are limited by their flexibility and lack structure. |
| Approach: | They propose a text-based compliance checking framework based on Retrieval-Augmented Generation that integrates a static layer for storing factual knowledge, a dynamic layer for retrieval and reasoning, and an eventic graph to structurally describe regulatory information. |
| Outcome: | The proposed framework consistently achieves state-of-the-art results across various scenarios surpassing baselines. |
Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognition (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing work on document classification models mainly uses synthetic monolingual data without ground truth for author demographic attributes. |
| Approach: | They assemble and publish a multilingual Twitter corpus for the task of hate speech detection using inferred author demographic factors. |
| Outcome: | The results show that the classifiers learn human biases and can be discriminatory towards certain demographic groups. |
Investigating the Working of Text Classifiers (C18-1)
Copied to clipboard
| Challenge: | Text classification is one of the most widely studied tasks in natural language processing. |
| Approach: | They propose to use large multilayer neural network models to compose meaning of sentences . they propose to disincentivize focusing on key lexicons to improve classification accuracy . |
| Outcome: | The proposed models learn to compose the meaning of the sentences or focus on key lexicons for classifying the document. |
“None of the Above”: Measure Uncertainty in Dialog Response Retrieval (2020.acl-main)
Copied to clipboard
| Challenge: | End-to-end (E2E) dialog retrieval models jointly encode a dialog and a candidate response, assuming the ground truth is always present in the candidate set. |
| Approach: | They propose to capture the original retrieval model's confidence concerning the best prediction using trivial additional computation. |
| Outcome: | The proposed model can capture the model's confidence concerning the best prediction using trivial additional computation. |
Dynamic Classification in Web Archiving Collections (2020.lrec-1)
Copied to clipboard
| Challenge: | a growing number of research libraries, museums, and archives are embracing Web Archiving as a mechanism to collect born-digital material made available via the Web. |
| Approach: | They propose to use dynamic fusion models to find the model that performs best on a variety of document types. |
| Outcome: | The proposed model outperforms individual models and other ensemble methods on three datasets. |
Data Expansion Using WordNet-based Semantic Expansion and Word Disambiguation for Cyberbullying Detection (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to identify cyberbullying from text are limited due to the complexity of the content and the lack of labeled large-scale corpus. |
| Approach: | They propose a data augmentation-based approach that could enhance the automatic detection of cyberbullying in social media texts. |
| Outcome: | The proposed approach overcomes limitations of social media posts with word sense disambiguation and synonymy relation . results show that the proposed approach improves on the existing classifiers with and without data augmentation. |
Mining Evidences for Concept Stock Recommendation (N18-1)
Copied to clipboard
| Challenge: | a recent announcement of a state plan to build a new economic region has led to the rise of hundreds of stocks . concepts can be useful for investors to find out relevant concept stocks for making investment decisions . a chinese research team uses deep learning to mine evidences from large textual data . |
| Approach: | They use distributed word similarities and deep reinforcement learning to learn a strategy of topic expansion from large scale textual data. |
| Outcome: | The proposed method outperforms a baseline method on two Chinese stock market datasets. |
FLiText: A Faster and Lighter Semi-Supervised Text Classification with Convolution Networks (2021.emnlp-main)
Copied to clipboard
| Challenge: | obtaining large amounts of labeled data is expensive. |
| Approach: | They develop a semi-supervised learning framework called FLiText which improves text classification accuracy. |
| Outcome: | The proposed framework improves accuracy of lightweight models on IMDb, Yelp-5, and Yahoo! Answer . the framework improve accuracy by 6.59%, 3.94%, and 3.22% on the datasets of IMDa, Yep-5 and Yahoo. Answer compared with the fully supervised method on the full dataset . |
Improved Multi-label Classification under Temporal Concept Drift: Rethinking Group-Robust Algorithms in a Label-Wise Setting (2022.findings-acl)
Copied to clipboard
| Challenge: | Large-scale multi-label document classification presents interesting challenges due to the large label space and two-tiered skewed label distributions. |
| Approach: | They evaluate several group-robust optimization algorithms proposed to mitigate temporal concept drift and class imbalance in document classification. |
| Outcome: | The proposed algorithms outperform sampling-based approaches to class imbalance and concept drift and lead to much better performance on minority classes. |
Diverse Multi-Answer Retrieval with Determinantal Point Processes (2022.coling-1)
Copied to clipboard
| Challenge: | Existing open domain question answering systems provide a single answer to ambiguous questions. |
| Approach: | They propose a re-ranking approach that takes query-passage relevance and passage-passance correlation into account to retrieve passages that are query-relevant and diverse. |
| Outcome: | The proposed method outperforms state-of-the-art on the AmbigQA dataset. |
Taxonomy and Analysis of Sensitive User Queries in Generative AI Search System (2025.findings-naacl)
Copied to clipboard
Hwiyeol Jo, Taiwoo Park, Hyunwoo Lee, Nayoung Choi, Changbong Kim, Ohjoon Kwon, Donghyeon Jeon, Eui Hyeon Lee, Kyoungho Shin, Lim Sun Suk, Kyungmi Kim, Lee Jihye, Sun Kim
| Challenge: | generative LLMs have been used by industries for various purposes, but limited resources and limited experience hinder their deployment and maintenance. |
| Approach: | They propose a taxonomy for sensitive search queries and outline approaches to generating generative LLMs. |
| Outcome: | The proposed model can be used to analyze sensitive queries from real users. |
Don’t sweat the small stuff, classify the rest: Sample Shielding to protect text classifiers against adversarial attacks (2022.naacl-main)
Copied to clipboard
| Challenge: | Current text classifiers are subject to adversarial attacks from adversaries, typically executed using machine learning methods. |
| Approach: | They propose a novel and intuitive defense strategy called Sample Shielding that is attacker and classifier agnostic and does not require reconfiguration of the classifier or external resources. |
| Outcome: | The proposed defense is attacker and classifier agnostic and does not require reconfiguration of the classifier or external resources and is simple to implement. |
Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for person anomaly search fail to address the complexities of real-world security, authors say . Existing approaches fail to detect subtle semantic distinctions, authors argue . |
| Approach: | They propose a framework that decouples retrieval into two stages . structure-aware coarse retrieval and detective squad interaction are proposed . |
| Outcome: | The proposed framework achieves state-of-the-art performance by balancing efficiency and semantic reasoning. |
On the Interplay Between Fine-tuning and Composition in Transformers (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained transformer language models have shown remarkable performance on a variety of NLP tasks. |
| Approach: | They propose to fine-tune transformer language models on a paraphrase and sentiment task and analyze their results to determine whether they benefit compositionality. |
| Outcome: | The proposed model performance on a paraphrase and sentiment task is compared with pre-trained models on lexical-level representations. |
Meta-Reflection: A Feedback-Free Reflection Learning Framework (2025.acl-long)
Copied to clipboard
Yaoke Wang, Yun Zhu, XintongBao XintongBao, Wenqiao Zhang, Suyang Dai, Kehan Chen, Wenqiang Li, Gang Huang, Siliang Tang, Yueting Zhuang
| Challenge: | Existing approaches to improve large language models' ability to understand and reason are limited by external feedback. |
| Approach: | They propose a feedback-free reflection mechanism that requires only a single inference pass without external feedback. |
| Outcome: | The proposed method is based on an industrial e-commerce benchmark and public datasets. |
Subword-Level Language Identification for Intra-Word Code-Switching (N19-1)
Copied to clipboard
| Challenge: | Code-switching (CS) is a phenomenon of alternating between two or more languages in conversations . if at least one language is morphologically rich, a large number of words can be composed of morphemes from more than one language. |
| Approach: | They propose to extend the language identification task to the subword level by splitting mixed words while tagging each part with a language ID. |
| Outcome: | The proposed model outperforms the baseline on a Spanish–Wixarika and adapted German–Turkish datasets. |
Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks (2023.eacl-main)
Copied to clipboard
| Challenge: | Statutory article retrieval (SAR) is a promising application of legal text processing. |
| Approach: | They propose a graph-augmented dense statute retriever model that incorporates the structure of legislation via a neural network to improve density retrieval performance. |
| Outcome: | The proposed model outperforms baselines on a real-world expert-annotated dataset. |
SEP-MLDC: A Simple and Effective Paradigm for Multi-Label Document Classification (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods focus on optimizing document features, overlooking the potential of high-quality label features to enhance classification performance. |
| Approach: | They propose a multi-label document classification paradigm that utilizes large language models to expand the label content and generate pseudo-samples for the tail categories. |
| Outcome: | The proposed method significantly outperforms state-of-the-art models. |
JuriFindIT: an Italian legal retrieval dataset (2026.findings-eacl)
Copied to clipboard
| Challenge: | Statutory article retrieval (SAR) targets retrieval of legislative provisions relevant to a natural language question. |
| Approach: | They propose a pipeline that integrates dense encoders with an heterogeneous legislative graph . they propose statutory article retrieval (SAR) is the first SAR dataset for the italian legal domain . |
| Outcome: | The proposed pipeline improves over existing approaches. |
Sequence Structure Aware Retriever for Procedural Document Retrieval: A New Dataset and Baseline (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing retrieval methods neglect the execution sequence structures inherent in procedural documents. |
| Approach: | They propose a retrieval model which integrates procedural graphs with document representations. |
| Outcome: | The proposed model integrates procedural graphs with document representations to improve document retrieval. |
Benchmarking Uncertainty Metrics for LLM Target-Aware Search (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing uncertainty metrics for LLM search methods do not capture the diverse types of uncertainty needed to guide different optimization goals. |
| Approach: | They propose a framework for uncertainty benchmarking that captures four different uncertainty types . the uncertainty types Answer, Correctness, Aleatoric, and Epistemic serve different optimization goals . |
| Outcome: | The proposed framework identifies four different uncertainty types . the uncertainty types serve different optimization goals in LLM search . |
Using Formulaic Expressions in Writing Assistance Systems (C18-1)
Copied to clipboard
| Challenge: | Existing computer-based writing assistance systems do not help non-native English speakers find better expressions than those they already know . existing FE dictionaries are limited in example sentences and are difficult to predict the category labels from user input, forcing users to manually designate the category when searching. |
| Approach: | They propose a framework for semantic searches of formulaic expressions and a method to leverage existing dictionaries and domain sentence corpora. |
| Outcome: | The proposed method leverages existing dictionaries and domain sentence corpora to find expressions that are not accurate. |
Building MUSCLE, a Dataset for MUltilingual Semantic Classification of Links between Entities (2024.lrec-main)
Copied to clipboard
| Challenge: | In this paper we present a dataset for MUltilingual Lexical Relation Classification (LRC) systems with 27K pairs of universal concepts selected from Wikidata, a large and highly multilingual factual Knowledge Graph (KG). |
| Approach: | They propose a dataset for MUltilingual lexico-semantic Classification of Links between Entities using 27K pairs of universal concepts selected from Wikidata. |
| Outcome: | The proposed dataset bridges lexical and conceptual semantics, avoids linguistic memorization, is domain-balanced across entities, and enables enrichment and hierarchical information retrieval. |
Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision (2022.coling-1)
Copied to clipboard
Khalil Mrini, Harpreet Singh, Franck Dernoncourt, Seunghyun Yoon, Trung Bui, Walter W. Chang, Emilia Farcas, Ndapa Nakashole
| Challenge: | Current medical question answering systems have difficulty processing long, detailed and informally worded questions . a growing number of approaches attempt to enhance the processing of consumer health questions - or medical question understanding . |
| Approach: | They propose a medical question understanding and answering system with knowledge grounding and semantic self-supervision that matches a user question with a trusted medical knowledge base and retrieves a fixed number of relevant sentences from the corresponding answer document. |
| Outcome: | The proposed system retrieves more relevant answers while achieving 20 times faster. |
Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for hierarchical multi-label classification do not assume label hierarchy exists. |
| Approach: | They propose to jointly learn the classifier parameters as well as the label embeddings . they propose to use hyperbolic embeddables to gain better generalisation over the labels . |
| Outcome: | The proposed method achieves state-of-the-art generalization on benchmarks and is more accurate than existing methods. |
Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution (2021.emnlp-main)
Copied to clipboard
Zongyi Li, Jianhan Xu, Jiehang Zeng, Linyang Li, Xiaoqing Zheng, Qi Zhang, Kai-Wei Chang, Cho-Jui Hsieh
| Challenge: | Existing methods to defend against adversarial word-substitution attacks have not been evaluated or compared in a systematic manner. |
| Approach: | They propose to compare different defense methods under representative adversarial attacks . they propose a method that improves the robustness of neural text classifiers against such attacks a . |
| Outcome: | The proposed method improves robustness of neural text classifiers against such attacks by a significant margin. |
GenPoE: Generative Passage-level Mixture of Experts for Knowledge Enhancement of LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | GenPoE is a passage-level mixture of experts for enhancing knowledge of large language models. |
| Approach: | They propose a novel “generative” passage-level mixture of experts (MoEs) that takes in-context retrieved passages and generates their “expert” parameters. |
| Outcome: | The proposed system is based on a novel hypernetwork which takes in-context retrieved passages and generates their "expert'' parameters. |
Self-Taught Agentic Long Context Understanding (2025.acl-long)
Copied to clipboard
Yufan Zhuang, Xiaodong Yu, Jialian Wu, Ximeng Sun, Ze Wang, Jiang Liu, Yusheng Su, Jingbo Shang, Zicheng Liu, Emad Barsoum
| Challenge: | Extensive experiments across seven long-context tasks demonstrate that AgenticLU significantly outperforms state-of-the-art prompting methods and specialized long-consumer LLMs. |
| Approach: | They propose a framework to enhance an LLM's understanding of long-context questions by integrating targeted self-clarification with contextual grounding within an agentic workflow. |
| Outcome: | The proposed framework outperforms state-of-the-art prompting methods and specialized long-context LLMs in seven long-constitut tasks. |
RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated excellent performance in numerous tasks but the parameterized knowledge stored within LLMs may be incomplete and hard to incorporate up-to-date knowledge. |
| Approach: | They propose a framework that iteratively decomposes tasks and processes them in three submodules to enhance the model’s problem-solving capabilities. |
| Outcome: | The proposed method outperforms existing benchmarks on GPT3.5, Llama2 and other large language models significantly enhancing factual reasoning capabilities and reducing hallucinations. |
A Two-Stage Decoder for Efficient ICD Coding (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent automated ICD coding efforts improve performance by encoding medical notes and codes with additional data and knowledge bases. |
| Approach: | They propose a two-stage decoding mechanism to predict ICD codes using hierarchical properties of the codes to split the prediction into two steps: at first, predict the parent code and then predict the child code based on the previous prediction. |
| Outcome: | Experiments on the public MIMIC-III data show that the proposed model performs well in single-model settings without external data or knowledge. |
Incorporating Syntax and Lexical Knowledge to Multilingual Sentiment Classification on Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | generative approach to multilingual sentiment classification is based on syntactic and lexical knowledge and requires retraining and tuning. |
| Approach: | They propose to use a sentiment extractor supported by syntactic and lexical resources to enhance multilingual sentiment classification without retraining LLMs. |
| Outcome: | The proposed approach reduces the multilingual sentiment classification error by 33 points and performs well even for nongenerative tasks such as topic classification and sentiment polarity judgment. |
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing rule retrieval methods suffer from low accuracy due to semantic gap between instantiated facts and abstract representations of rules. |
| Approach: | They propose a method that induces inferential rules that might offer benefits for reasoning by abstracting the underlying knowledge and logical structure in queries. |
| Outcome: | The proposed method improves retrieval effectiveness and accuracy across settings. |
Jump To Hyperspace: Comparing Euclidean and Hyperbolic Loss Functions for Hierarchical Multi-Label Text Classification (2025.coling-main)
Copied to clipboard
| Challenge: | Hierarchical Multi-Label Text Classification (HMTC) is a challenging machine learning task . a recent study evaluated the effectiveness of Euclidean and hyperbolic loss functions on HMTC . |
| Approach: | They evaluate label-aware and contrastive losses in the Euclidean and hyperbolic space . they find contrastive loss functions are less effective when deployed in the hyperbolical space compared to non-hyperbolic ones . |
| Outcome: | The proposed model improves on four commonly used HMTC datasets. |
Platt-Bin: Efficient Posterior Calibrated Training for NLP Classifiers (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for posterior calibration return uncalibrated estimations of class posteriors, thus leading to poorer generalization. |
| Approach: | They propose an end-to-end trained calibrator that directly optimizes the objective while minimizing the difference between predicted and empirical posterior probabilities. |
| Outcome: | The proposed calibrator reduces calibration error and improves performance on benchmark NLP classification tasks. |
Personalized Text Retrieval for Learners of Chinese as a Foreign Language (C18-1)
Copied to clipboard
| Challenge: | a personalized text retrieval algorithm helps language learners select the most suitable reading material in terms of vocabulary complexity. |
| Approach: | They propose a personalized text retrieval algorithm that helps language learners select the most suitable reading material in terms of vocabulary complexity. |
| Outcome: | The proposed algorithm is effective in identifying simpler texts for low-proficiency learners, and more challenging ones for high-proficient learners. |
BRIEF: Bridging Retrieval and Inference for Multi-hop Reasoning via Compression (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to augment language models with external knowledge but they are limited by static nature of pre-training data. |
| Approach: | They propose a lightweight approach that compresses retrieved documents into highly dense textual summaries to integrate into in-context RAG. |
| Outcome: | The proposed approach reduces latency and costs while achieving high performance in open-domain questions. |
ThoughtProbe: Classifier-Guided LLM Thought Space Exploration via Probing Representations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Unlike previous works that manipulate representations to steer LLM generation, ThoughtProbe harnesses them as discriminative signals to guide the tree-structured response space exploration. |
| Approach: | They propose a tree-structured inference-time framework that leverages the hidden reasoning features of Large Language Models to improve their reasoning performance. |
| Outcome: | The proposed framework improves reasoning performance across multiple arithmetic reasoning benchmarks and covers valid reasoning chains and identifies optimal answers. |
Retrieval-Augmented Generative Question Answering for Event Argument Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extract arguments from documents are based on generating and post-processing a complex target sequence (template). |
| Approach: | They propose a retrieval-augmented generative QA model that retrieves the most similar QA pair and augments it as prompt to the current example's context, then decodes the arguments as answers. |
| Outcome: | The proposed model outperforms prior methods across fully supervised, domain transfer, and fewshot learning settings and compares with clustering-based sampling strategies. |
Identifying Spurious Correlations for Robust Text Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Text classifiers often rely on spurious correlations to predict positive reviews . term Spielberg does not cause the review to be positive, so it does not affect the classification accuracy. |
| Approach: | They propose a method to distinguish spurious and genuine correlations in text classification using treatment effect estimators. |
| Outcome: | The proposed method works well even with limited training examples and is possible to transport the word classifier to new domains. |
Calibrating LLMs with Preference Optimization on Thought Trees for Generating Rationale in Science Question Scoring (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating rationales that justify scoring decisions are not accurate and often contain hallucinated information. |
| Approach: | They propose a framework capable of generating more faithful rationales and matching performance with classifier-based scoring systems. |
| Outcome: | The proposed framework achieves 38% improvement in QWK score compared to prior work . it can be used to match performance with classifier-based scoring systems . |
Examining and Adapting Time for Multilingual Classification via Mixture of Temporal Experts (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing classification models only consider the temporal variations of existing data . current models focus on English corpora, leaving time as domains unexplored . |
| Approach: | They propose a framework to generalize classifiers over time on four languages, English, Danish, French, and German. |
| Outcome: | The proposed framework can generalize classifiers over time on four languages, English, Danish, French, and German. |
Cross-Lingual Document Retrieval with Smooth Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Cross-lingual document search is an information retrieval task in which the queries’ language and the documents’ language are different. |
| Approach: | They propose a robust framework that measures the relevance and a loss function that is a novel objective function. |
| Outcome: | The proposed framework achieves significant gains under commonly used ranking metrics on cross-lingual document retrieval task in a variety of languages. |
Redefining Absent Keyphrases and their Effect on Retrieval Effectiveness (2021.naacl-main)
Copied to clipboard
| Challenge: | Neural keyphrase generation models can output absent keyphrases, which are keyphrase that do not appear in the source text. |
| Approach: | They propose a finer-grained categorization scheme that sheds more light on the impact of absent keyphrases on scientific document retrieval. |
| Outcome: | The proposed model shows that only 20% of the words that make up keyphrases actually serve as document expansion, but this small fraction behind much of the gains observed in retrieval effectiveness. |
Disentangling Categorization in Multi-agent Emergent Communication (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work on the emergence of language between artificial agents has not isolated the effect of categorization power on inter-communication ability. |
| Approach: | They propose to use disentangled representations to quantify categorization power of agents to enable differential analysis between combinations of heterogeneous systems. |
| Outcome: | The proposed method reduces signaling accuracy by 40% despite encouraging compositionality in the artificial language. |
TOME: A Two-stage Approach for Model-based Retrieval (2023.acl-long)
Copied to clipboard
| Challenge: | Recent research has focused on model-based retrieval, which discards the index in the traditional retrieval model and memorizes the candidate corpora using model parameters. |
| Approach: | They propose a model-based retrieval approach that discards the index in the traditional retrieval model and memorizes the candidate corpora using model parameters. |
| Outcome: | The proposed approach eliminates the index in the traditional retrieval model and memorizes the candidate corpora using model parameters. |
Hierarchy-aware Label Semantics Matching Network for Hierarchical Text Classification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods ignore the semantic relationship between text and labels, so they cannot make full use of hierarchical information. |
| Approach: | They propose a hierarchy-aware label semantics matching network to model the semantic relationship between text and labels in a semantic matching problem. |
| Outcome: | The proposed model captures the text-label semantics matching relationship among coarse-grained labels and fine-grain labels in a hierarchy-aware manner. |
Legal Case Retrieval: A Survey of the State of the Art (2024.acl-long)
Copied to clipboard
| Challenge: | Recent years have seen increasing attention on Legal Case Retrieval (LCR) this task involves retrieving cases from a legal database of historical cases that are similar to a given query case. |
| Approach: | They present a survey of the major milestones made in legal case retrieval research . they seek to understand the datasets and recent neural models and their performances . |
| Outcome: | The proposed task is based on a dataset of historical cases similar to a given query case. |
Personalized Text Generation with Contrastive Activation Steering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to personalized text generation rely on retrieval-augmented generation and parameter-efficient fine-tuning. |
| Approach: | They propose a training-free framework that disentangles and represents personalized writing style as a vector in LLM’s activation-space. |
| Outcome: | The proposed framework achieves 8% relative improvement in personalized generation while reducing storage requirements by 1700 over PEFT method. |
Inter-Passage Verification for Multi-evidence Multi-answer QA (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing multi-answer question answering systems struggle to retrieve and synthesize a large number of evidence passages. |
| Approach: | They propose a multi-answer question answering framework that generates a large set of passages and then processes each passage individually to generate an initial high-recall but noisy answer set. |
| Outcome: | The proposed framework outperforms baselines on the QAMPARI and RoMQA datasets, achieving an average F1 score improvement of 11.17%. |
ARISE: Iterative Rule Induction and Synthetic Data Generation for Text Classification (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing frameworks for large language models (LLMs) generate high-quality synthetic data that can be used to supplement training data or surpass crowd-sourced annotations. |
| Approach: | They propose a framework that iteratively induces rules and generates synthetic data for text classification. |
| Outcome: | The proposed framework outperforms existing models on in-context learning and fine-tuning settings by using augmented data. |
Decomposing Complex Queries for Tip-of-the-tongue Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Tip-of-the-tongue retrieval is a retrieval setting in which a user is unable to formulate a precise query that identifies a sought item . a framework that decomposes complex queries into subqueries can improve gold book recall . |
| Approach: | They propose a framework for handling tip-of-the-tongue queries by decomposing queries into individual clues routing them to specialized retrievers. |
| Outcome: | The proposed framework improves gold book recall up to 6% on a new query-book pair . it takes advantage of off-the-shelf retrievers or incorporates retriever-specific logic . |
Script-Agnosticism and its Impact on Language Identification for Dravidian Languages (2025.naacl-long)
Copied to clipboard
| Challenge: | a recent study shows that modern systems are script-dependent in language identification (langID) many languages are written in multiple writing systems, and script diversity is common in low-resource languages. |
| Approach: | They propose to learn script-agnostic representations using different strategies . they use word-level script randomization and script exposure to a language written in multiple scripts . |
| Outcome: | The proposed methods exploit script randomization and exposure to a language written in multiple scripts to improve language identification while maintaining competitive performance on naturally occurring text. |
An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next (2021.findings-emnlp)
Copied to clipboard
Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Hassan Awadallah, Dragomir Radev
| Challenge: | Existing models for dialogue summarization focus on extracting the main events of short conversations, but real-world dialogues are difficult to train. |
| Approach: | They propose three strategies to deal with the lengthy input problem and locate relevant information using long dialogue datasets. |
| Outcome: | The retrieve-then-summarize pipeline models yield the best performance on three long dialogue datasets. |
A Danish FrameNet Lexicon and an Annotated Corpus Used for Training and Evaluating a Semantic Frame Classifier (L18-1)
Copied to clipboard
| Challenge: | a Danish FrameNet is a lexicon based on the Danish Thesaurus . it is significantly faster than building a new one from scratch . |
| Approach: | They propose a way to efficiently compile a Danish FrameNet based on the Danish Thesaurus . they present the corresponding corpus annotations of frames and roles and show how this can be used for a semantic frame classifier . |
| Outcome: | The proposed approach is faster than building a lexicon from scratch. |
CuSINeS: Curriculum-driven Structure Induced Negative Sampling for Statutory Article Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to assess Statutory Article Retrieval (SAR) are vague and underspecified, resulting in a lack of clarity and a gap between legal expertise and public comprehension. |
| Approach: | They propose a negative sampling approach to enhance the performance of Statutory Article Retrieval (SAR) it employs a curriculum-based negative sampling strategy guiding the model to focus on easier negatives initially and progressively tackle more difficult ones. |
| Outcome: | The proposed approach surpasses static methods and can be used to assess the difficulty of the model. |
Attentive Gated Lexicon Reader with Contrastive Contextual Co-Attention for Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing sentiment lexicons do not handle word sense and the concept of semantic compositionality is non-existent in simple lexiconic approaches. |
| Approach: | They propose a lexicon-driven contextual attention mechanism and a contrastive co-attention mechanism that models contrasting polarities between all positive and negative words in a sentence. |
| Outcome: | The proposed model outperforms many other neural baselines on sentiment classification tasks on multiple benchmark datasets. |
Data Collection Pipeline for Low-Resource Languages: A Case Study on Constructing a Tetun Text Corpus (2024.lrec-main)
Copied to clipboard
| Challenge: | Labadain Crawler is a data collection pipeline designed to automate and optimize the process of constructing textual corpora from the web, with a specific target to low-resource languages. |
| Approach: | They propose a data collection pipeline built on top of Nutch, an open-source web crawler and data extraction framework, and a tokenizer and identifier for Tetun. |
| Outcome: | The proposed pipeline is based on Nutch, an open-source web crawler and data extraction framework, and is tested with Tetun, one of Timor-Leste’s official languages. |
Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to solve multi-hop question are constrained by the retriever and the noise in the retrieved documents. |
| Approach: | They propose a framework that integrates parametric knowledge of large language models with external documents to solve a multi-hop question. |
| Outcome: | The proposed framework is based on the parametric knowledge of LLMs and external documents to solve a multi-hop question. |
Natural Logic-guided Autoregressive Multi-hop Document Retrieval for Fact Verification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent evidence retrieval approaches rely on heuristics and assume hyperlinks between documents. |
| Approach: | They propose a retrieval method that combines a retriever and a proof system that reranks documents and reorders them . |
| Outcome: | The proposed method exceeds or is on par with the current state-of-the-art on FEVER, HoVer and FEVEROUS-S while using 5 to 10 times less memory than competing systems. |
Shedding New Light on the Language of the Dark Web (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing studies on text classification of the Dark Web have been ineffective due to its inherent characteristics. |
| Approach: | They propose a publicly available Dark Web dataset tailored towards text-based analysis. |
| Outcome: | The proposed method compares with an existing public Dark Web dataset and evaluates its suitability for various use cases. |
Depth Aware Hierarchical Replay Continual Learning for Knowledge Based Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Continual learning models adapt well to the latest data but lose ability to remember past data due to changes in the data source. |
| Approach: | They propose a hierarchical replay framework that allows models to keep a small memory of previous learned data that uses replay. |
| Outcome: | The proposed model outperforms previous continual learning methods in mitigating catastrophic forgetting. |
HOTTER: Hierarchical Optimal Topic Transport with Explanatory Context Representations (2021.findings-emnlp)
Copied to clipboard
Sabine Wehnert, Christian Scheel, Simona Szakács-Behling, Maret Nieländer, Patrick Mielke, Ernesto William De Luca
| Challenge: | Natural language processing (NLP) is often the backbone of today’s systems for user interactions, information retrieval and others. |
| Approach: | They propose an extension to a specific emerging hybrid document distance metric which combines topic models and word embeddings. |
| Outcome: | The proposed method is competitive on public datasets and the language model BERT is used for a document categorization task. |
Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration (2024.findings-acl)
Copied to clipboard
Sunhao Dai, Weihao Liu, Yuqi Zhou, Liang Pang, Rongju Ruan, Gang Wang, Zhenhua Dong, Jun Xu, Ji-Rong Wen
| Challenge: | Large Language Models (LLMs) have led to an influx of AI-generated content on the internet, transforming corpus of Information Retrieval (IR) systems from human-written to a coexistence with LLM-generated contents. |
| Approach: | They propose a benchmark named Cocktail that compares IR models with LLMs to find relevant documents and passages from a corpus. |
| Outcome: | The proposed benchmark aims to evaluate IR models in the mixed-sourced data landscape of the LLM era. |
Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics (2024.lrec-main)
Copied to clipboard
Tyler A. Chang, Katrin Tomanek, Jessica Hoffmann, Nithum Thain, Erin MacMurray van Liemt, Kathleen Meier-Hellstern, Lucas Dixon
| Challenge: | a growing audience of users is engaging with LLM-driven chatbots. |
| Approach: | They propose a strategy to handle controversial topics in LLM-based chatbots based on Wikipedia’s Neutral Point of View principle. |
| Outcome: | The proposed methods detect errors in the tuned LLM responses even when no training data is available. |
Inflating Topic Relevance with Ideology: A Case Study of Political Ideology Bias in Social Topic Detection Models (2020.coling-main)
Copied to clipboard
| Challenge: | a study examines the impact of political ideology biases in training data . topic detection methods may contain or propagate certain biase resulting in a skewed data collection . |
| Approach: | They propose to learn a text representation that is invariant to political ideology while still judging topic relevance. |
| Outcome: | The proposed model can be invariant to political ideology while still judging topic relevance. |
Two-level classification for dialogue act recognition in task-oriented dialogues (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for dialogue act classification are limited and feature sets are low . recognizing dialogue acts is useful for identifying type of information and knowledge to be conveyed . |
| Approach: | They propose a 2-level classification technique, distinguishing between generic and specific dialogue acts (DA) they propose an efficient approach for specific DA, based on high-level linguistic features. |
| Outcome: | The proposed method outperforms classical methods for DA classification by including high-level features. |
CLERC: A Dataset for U. S. Legal Case Retrieval and Retrieval-Augmented Analysis Generation (2025.findings-naacl)
Copied to clipboard
Abe Bohan Hou, Orion Weller, Guanghui Qin, Eugene Yang, Dawn Lawrie, Nils Holzenberger, Andrew Blair-Stanek, Benjamin Van Durme
| Challenge: | a dataset of case law is used to train and evaluate models for writing legal analyses . current approaches struggle to find relevant cases and generate legal analyses, authors say . |
| Approach: | They build a dataset of case law to support information retrieval and retrieval-augmented generation. |
| Outcome: | The proposed dataset supports two important backbone tasks: retrieval (IR) and retrieval-augmented generation (RAG). |
NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLM (2025.findings-acl)
Copied to clipboard
| Challenge: | High-performance vision-and-language navigation models require large amounts of training data, the high cost of manual annotating has seriously hindered this field. |
| Approach: | They propose a retrieval-augmented generation framework that generates user demand instructions for vision-and-language navigation. |
| Outcome: | The proposed model achieves SOTA performance on the REVERIE benchmark. |
CoSQA: 20,000+ Web Queries for Code Search and Question Answering (2021.acl-long)
Copied to clipboard
| Challenge: | Using deep neural networks to find codes is difficult . we present a dataset that includes 20,604 labels for natural language queries and codes . |
| Approach: | They introduce a contrastive learning method to enhance text-code matching . they find that CoSQA improves the accuracy of code question answering by 5.1% . |
| Outcome: | The proposed method improves the accuracy of code question answering by 5.1% and improves by 10.5% on a CodeBERT model. |
AttnComp: Attention-Guided Adaptive Context Compression for Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for augmented large language models suffer from irrelevant retrieved content . existing methods struggle to adapt compression rates for different context, maintain low latency . |
| Approach: | We propose an adaptive, efficient and context-aware compression framework to reduce retrieved content . AttnComp uses a top-p compression algorithm to retain the minimal set of documents whose attention weights exceed a threshold. |
| Outcome: | Experiments show that AttnComp outperforms existing compression methods and uncompressed baselines in achieving higher accuracy with substantial compression rates and lower latency. |
Text Counterfactuals via Latent Optimization and Shapley-Guided Search (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using latent optimization and Shapley values, we generate a set of minimal modifications to the text to change the classifier's prediction. |
| Approach: | They propose to generate a counterfactual by making minimal modifications to the text to change the model's prediction. |
| Outcome: | The proposed approach achieves favorable performance compared to white-box and black-box baselines using human and automatic evaluations. |
Instance-Selection-Inspired Undersampling Strategies for Bias Reduction in Small and Large Language Models for Binary Text Classification (2025.acl-long)
Copied to clipboard
Guilherme Fonseca, Washington Cunha, Gabriel Prenassi, Marcos André Gonçalves, Leonardo Chaves Dutra Da Rocha
| Challenge: | Existing methods to mitigate class imbalanced datasets are limited by existing methods. |
| Approach: | They propose two undersampling methods inspired by state-of-the-art Instance Selection techniques to mitigate class imbalance bias in ATC. |
| Outcome: | The proposed methods reduce classifier bias (56%) across all datasets without effectiveness loss while improving efficiency (1.6x speedup), scalability and reducing carbon emissions (up to 50%). |
HeGeL: A Novel Dataset for Geo-Location from Hebrew Text (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets in English for textual geolocation are limited because of the location of the place is implicit. |
| Approach: | They propose to use a Hebrew place description corpus to analyze lingual geospatial reasoning. |
| Outcome: | The Hebrew Geo-Location corpus collects literal Hebrew place descriptions and analyzes lingual geospatial reasoning. |
A Statutory Article Retrieval Dataset in French (2022.acl-long)
Copied to clipboard
| Challenge: | Statutory article retrieval is the task of automatically retrieving law articles relevant to a legal question. |
| Approach: | They propose to use a Belgian Statutory Article Retrieval Dataset to test various retrieval approaches including lexical and dense architectures to achieve a 74.8% R@100. |
| Outcome: | The proposed dataset outperforms existing systems in both zero-shot and supervised setups. |
Interpreting Sentiment Composition with Latent Semantic Tree (2023.findings-acl)
Copied to clipboard
| Challenge: | Current researches on sentiment classification are shifting from improving model performance to interpretability. |
| Approach: | They propose a new tree form capable of interpreting sentiment composition in a principled way. |
| Outcome: | The proposed tree can explain sentiment composition in a principled way. |
Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications (2021.emnlp-main)
Copied to clipboard
| Challenge: | Sentence-level Quality estimation (QE) is traditionally a regression task . but large multilingual contextualized language models are expensive and infeasible for real-world applications. |
| Approach: | They evaluate several model compression techniques for QE and find they are inefficient . they argue that a full model parameterization is required to achieve SoTA results . |
| Outcome: | The proposed models are poorly expressive in a regression task, the authors argue . they show that reframing QE as a classification problem and evaluating models would improve their performance in real-world applications. |
MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process often struggles to reconcile evidence effectively. |
| Approach: | They propose a multi-agent synthesis approach to retrieval-augmented generation that structures evidence processing into multiple role-specialized agents. |
| Outcome: | Experiments on four benchmarks show that MASS-RAG consistently improves performance over strong RAG baselines. |
Efficient Shapley Values Estimation by Amortization for Text Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Shapley Values are often estimated with a small number of stochastic model evaluations, but this can only be mitigated by aggregating thousands of model evaluation. |
| Approach: | They propose to combine a model with thousands of model evaluations to estimate Shapley Values without additional model evaluation. |
| Outcome: | The proposed model estimates Shapley Values accurately with up to 60 times speedup compared to traditional methods and does not suffer from stability issues as inference is deterministic. |
Evaluating Retrieval for Multi-domain Scientific Publications (2022.lrec-1)
Copied to clipboard
Nancy Ide, Keith Suderman, Jingxuan Tu, Marc Verhagen, Shanan Peters, Ian Ross, John Lawson, Andrew Borg, James Pustejovsky
| Challenge: | a new framework for retrieval and mining of scientific publications is being developed . the AskMe retrieval engine is a bridge between xDD's publication database and the LAPPS Grid suite of NLP tools. |
| Approach: | They evaluate AskMe retrievalengine using BEIR benchmark datasets . they aim to determine when and why certain approaches perform well on in-domain and out-of-domain data. |
| Outcome: | The AskMe retrieval engine performs well on both in-domain and out-of-domain data. |
AURORA: Neuro-Symbolic Continual Indexing for Evolving RAG Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) systems depend on non-parametric indices to access external knowledge. |
| Approach: | They propose a framework for adapting retrieval indices under distribution shift . AURORA decouples discrete index structure from continuous metric representations . it recovers +26.9% Recall@10 on novel topics compared to static baselines compared with static baseline . |
| Outcome: | AURORA decouples discrete index structure from continuous metric representations . it recovers +26.9% Recall@10 on novel topics while adapting significantly faster than full retraining. |
End-to-End Autoregressive Retrieval via Bootstrapping for Smart Reply Systems (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Reply suggestion systems are poorly suited for out-of-the-box retrieval architectures, which only consider individual message-reply similarity. |
| Approach: | They propose an autoregressive text-to-text retrieval model that learns the smart reply task end-to end from a dataset of (message, reply set) pairs obtained via bootstrapping. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on three datasets and shows that it is more diverse and relevant to the user. |
CoQuIR: A Comprehensive Benchmark for Code Quality-Aware Information Retrieval (2026.acl-long)
Copied to clipboard
Jiahui Geng, Fengyu Cai, Shaobo Cui, Qing Li, Liangwei Chen, Chenyang Lyu, Haonan Li, Derui Zhu, Alexander Pretschner, Heinz Koeppl, Fakhri Karray
| Challenge: | Existing benchmarks focus on functional relevance while neglecting code quality. |
| Approach: | They propose a multilingual benchmark to evaluate quality-aware code retrieval . they include fine-grained quality annotations over 42,725 queries and 134,907 code snippets . |
| Outcome: | The proposed benchmarks show that state-of-the-art models fail to separate buggy or insecure code from robust counterparts. |
Learning Dense Representations of Phrases at Scale (2021.acl-long)
Copied to clipboard
| Challenge: | Existing phrase retrieval models rely on sparse representations and still underperform retriever-reader approaches. |
| Approach: | They propose a method to learn phrase representations from reading comprehension tasks using negative sampling methods. |
| Outcome: | The proposed model improves over previous models by 15%-25% absolute accuracy and matches the performance of state-of-the-art retrieval models. |
Lifting Optimized Binaries to Canonical Compiler IR via Structure-Aware Retrieval and Iterative Verification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for decompiling binary code are brittle due to compiler optimizations that distort control-flow and data-flow structure. |
| Approach: | They propose a system that lifts optimized binaries to canonical compiler intermediate representation (IR) BRIDGE uses control-flow-aware retrieval-augmented generation with feedback-driven verification . |
| Outcome: | The proposed system outperforms seven baselines on humanEval-Decompile and MBPP, lifting x86-64 and ARM64 binaries to LLVM IR. |
Class Name Guided Out-of-Scope Intent Classification (2024.findings-emnlp)
Copied to clipboard
Chandan Gautam, Sethupathy Parameswaran, Aditya Kane, Yuan Fang, Savitha Ramasamy, Suresh Sundaram, Sunil Sahu, Xiaoli Li
| Challenge: | SCOOS leverages semantic cues embedded in class labels to improve classification accuracy. |
| Approach: | They propose a method to create a compact feature space around class label semantics . they use a shared latent space between ID features and class names to minimize losses . |
| Outcome: | The proposed method outperforms existing methods for out-of-scope intent detection and ID intent classification. |
Revisiting Transformer-based Models for Long Document Classification (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent literature in text classification is biased towards short text sequences . multi-page multi-paragraph documents cannot be efficiently encoded by vanilla transformers based on short text. |
| Approach: | They compare different Transformer-based Long Document Classification approaches to mitigate the computational overhead of vanilla transformers to encode much longer text. |
| Outcome: | The proposed models can process longer text and provide practical advice for long document classification tasks. |
RAG or Learning? Understanding the Limits of LLM Adaptation under Continuous Knowledge Drift in the Real World (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to update or supplement large language models struggle under continuous knowledge drift. |
| Approach: | They propose a dynamic event benchmark and time-aware retrieval baseline that captures how knowledge evolves over time. |
| Outcome: | The proposed method enables systematic evaluation of model adaptation under continuous knowledge drift. |
Improving Factuality with Explicit Working Memory (2025.acl-long)
Copied to clipboard
Mingda Chen, Yang Li, Karthik Padthe, Rulin Shao, Alicia Yi Sun, Luke Zettlemoyer, Gargi Ghosh, Wen-tau Yih
| Challenge: | Large language models can generate factually inaccurate content, a problem known as hallucination. |
| Approach: | They propose an approach that integrates a working memory that receives feedback from external resources. |
| Outcome: | The proposed method outperforms baselines on four fact-seeking datasets and increases the factuality metric by 2 to 6 points absolute. |
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to build a strong multilingual multimodal representation model are lacking in good-quality text-image pairs. |
| Approach: | They propose a method to build a strong multilingual multimodal representation model using English text-image pairs instead of a model from scratch. |
| Outcome: | The proposed model outperforms the original CLIP model on multilingual multimodal benchmarks. |
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)
Copied to clipboard
Xinke Jiang, Yue Fang, Rihong Qiu, Haoyu Zhang, Yongxin Xu, Hao Chen, Wentao Zhang, Ruizhe Zhang, Yuchen Fang, Xinyu Ma, Xu Chu, Junfeng Zhao, Yasha Wang
| Challenge: | Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation. |
| Approach: | They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting. |
| Outcome: | The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods. |
Sequential Learning of Convolutional Features for Effective Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing models for text classification have largely ignored convolution filters and max pooling . text classification is one of the major applications of natural language processing . |
| Approach: | They propose a convolutional attentive recurrent network model which uses convolution filters and max pooling to improve text classification. |
| Outcome: | The proposed model outperforms existing convolutional models on text classification tasks. |
DataFinder: Scientific Dataset Recommendation from Natural Language Descriptions (2023.acl-long)
Copied to clipboard
| Challenge: | Modern machine learning relies on datasets to develop and validate research ideas. |
| Approach: | They propose a dataset recommendation system that uses a training set and an evaluation set to help people find relevant datasets. |
| Outcome: | The proposed model finds more relevant search results than existing third-party search engines. |
Modeling Trolling in Social Media Conversations (L18-1)
Copied to clipboard
| Challenge: | a new classification of trolling allows for comment-based analysis from both the trolls' and the responders' perspectives . a trolled's intentions may cause a negative psychological impact on the participants . |
| Approach: | They propose a trolling categorization that allows comment-based analysis from both trolls' and responders' perspectives . they annotate and release a dataset containing excerpts of Reddit conversations involving suspected trolled users . |
| Outcome: | The proposed model allows comment-based analysis from both the trolls' and the responders' perspectives. |
Listen, Watch, and Learn to Feel: Retrieval-Augmented Emotion Reasoning for Compound Emotion Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to assess human emotion are limited by the subjective nature of emotion perception, limiting the robustness of existing models. |
| Approach: | They propose a plug-and-play module that enhances MLLMs’ ability to tackle compound and context-rich emotion tasks. |
| Outcome: | The proposed framework improves MLLMs' ability to tackle compound and context-rich emotion tasks and the Compound Emotion QA dataset shows it performs well across both benchmarks and evaluation frameworks. |
Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptation (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are mainly trained on English data and struggle with low-resource languages. |
| Approach: | They propose to add a new language to Llama to improve classification accuracy for Persian tasks by aligning representations through bilingual pretraining and instruction datasets. |
| Outcome: | The proposed model performs on generation and classification tasks with no adverse impact and sometimes even improvements on English tasks. |
MoR: Better Handling Diverse Queries with a Mixture of Sparse, Dense, and Human Retrievers (2025.emnlp-main)
Copied to clipboard
| Challenge: | Different retrievers offer distinct, often complementary signals, but they are not optimal for all queries. |
| Approach: | They propose a zero-shot, weighted combination of heterogeneous retrievers . they validate this intuition by incorporating specialized non-oracle human information sources . |
| Outcome: | Experiments show that a mixture of heterogeneous retrievers outperforms each retriever and larger models by +10.8% and +3.9% on average. |
RoboFailRing: Retrieval-Augmented and Language Grounding Failure Detection for VLM-enabled Robotic Manipulation (2026.acl-long)
Copied to clipboard
| Challenge: | RoboFailRing enables timely failure detection during task execution and enhances reasoning accuracy of VLMs. |
| Approach: | They propose a robot-based failure detection system that enables timely failure detection . they evaluate a large-scale simulated dataset and provide a grounded failure report . |
| Outcome: | The proposed method achieves rapid failure detection and returns similarity-based decision on large-scale simulated failures. |
CWID-hi: A Dataset for Complex Word Identification in Hindi Text (2022.lrec-1)
Copied to clipboard
| Challenge: | Text simplification is a method for improving the accessibility of text by converting complex sentences into simple sentences. |
| Approach: | They propose to use Hindi knowledge annotators to capture the annotator’s language knowledge to build an automatic complex word classifier using a soft voting approach. |
| Outcome: | The proposed dataset shows that native and non-native annotators perceive complex words differently depending on their language knowledge. |
Label-Aware Hyperbolic Embeddings for Fine-grained Emotion Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Existing models only address text classification problem in the euclidean space, which is not optimal . e.g., fear and terrified labels may not be differentiated in such space, harming performance . |
| Approach: | They propose a framework that can integrate hyperbolic embeddings to improve the task . they learn label embeddements in the hyperbolical space and then add them to the framework . |
| Outcome: | The proposed framework improves fine-grained emotion classification on two benchmark datasets with 3% improvement over previous state-of-the-art models. |
ParlVote: A Corpus for Sentiment Analysis of Political Debates (2020.lrec-1)
Copied to clipboard
| Challenge: | Debate transcripts from the UK Parliament contain information about the positions taken by politicians towards important topics, but are difficult for humans to process manually. |
| Approach: | They propose to use a linear classifier and a transformer word embedding model to classify sentiment polarity in debate speeches to evaluate sentiment analysis systems for the political domain. |
| Outcome: | The proposed method performs better on the largest dataset and is more robust to other datasets. |
Rationale-Guided Retrieval Augmented Generation for Medical Question Answering (2025.naacl-long)
Copied to clipboard
Jiwoong Sohn, Yein Park, Chanwoong Yoon, Sihyeon Park, Hyeon Hwang, Mujeen Sung, Hyunjae Kim, Jaewoo Kang
| Challenge: | Large language models (LLMs) struggle with hallucinations and outdated knowledge. |
| Approach: | They propose a retrieval-augmented generation framework for enhancing the reliability of RAG in biomedical contexts. |
| Outcome: | The proposed framework outperforms the previous best medical RAG model by up to 5.6% across three medical question-answering benchmarks. |
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification (P19-1)
Copied to clipboard
| Challenge: | Existing paragraph embedding methods do not capture basic linguistic properties, but their performance is limited. |
| Approach: | They propose a paragraph embedding method that can't tell whether a sentence occurs in a given paragraph. |
| Outcome: | The proposed method outperforms reconstruction-based methods on a semi-supervised dataset and improves on benchmark datasets. |
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)
Copied to clipboard
Liu Huanshuo, Hao Zhang, Zhijiang Guo, Jing Wang, Kuicai Dong, Xiangyang Li, Yi Quan Lee, Cong Zhang, Yong Liu
| Challenge: | Existing methods focus on detecting LLM’s confidence via statistical uncertainty. |
| Approach: | They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge. |
| Outcome: | The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks. |
Building a Sentiment Corpus of Tweets in Brazilian Portuguese (L18-1)
Copied to clipboard
| Challenge: | Sentiment analysis is a popular area of Natural Language Processing due to its subjective and semantic characteristics. |
| Approach: | They propose to annotate Brazilian Portuguese sentences manually using a sentiment corpus . they run experiments on polarity classification using six machine learning classifiers . |
| Outcome: | The proposed method is based on a Brazilian Portuguese sentiment corpus and achieved 80.38% on F-Measure and 64.87% when including the neutral class. |
PQR: Improving Dense Retrieval via Potential Query Modeling (2025.acl-long)
Copied to clipboard
| Challenge: | Existing training data is sparse, with each document associated with one or a few labeled queries. |
| Approach: | They propose a training-free potential query retrieval framework to address this problem . they use a Gaussian mixture distribution to model all potential queries for a document . |
| Outcome: | The proposed method is able to capture comprehensive semantic information from a document with multiple queries. |
Exploiting Instruction-Following Retrievers for Malicious Information Retrieval (2025.findings-acl)
Copied to clipboard
| Challenge: | Instruction-following retrievers are increasingly used in real-world applications, but little research has investigated the safety risks associated with their increasing search capabilities. |
| Approach: | They investigate the ability of retrievers to satisfy malicious queries . they find that for >50% of queries, retrievers can select harmful passages . |
| Outcome: | The findings highlight the safety risks associated with instruction-following retrievers . they show that even safety-aligned LLMs can satisfy malicious requests . |
Hybrid Hierarchical Retrieval for Open-Domain Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work shows that dense hierarchical retrieval (DHR) can outperform dense passage retrieval. |
| Approach: | They propose a framework that applies sparse, dense and a combination of them to document and passage retrieval. |
| Outcome: | The proposed framework can outperform dense hierarchical retrieval (DHR) and sparse retrievers (BM25) on open-domain question answering (ODQA) datasets with an average improvement of 4.69% on recall@100 over DHR. |
FAITH: Factuality Alignment through Integrating Trustworthiness and Honestness (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to correct factually inaccurate outputs are lacking the semantic richness needed to properly understand its internal states of trustworthiness and honesty. |
| Approach: | They propose a framework for factuality alignment that integrates natural-language uncertainty signals with external knowledge and computes confidence scores and semantic entropy from LLM outputs. |
| Outcome: | Extensive experiments on four knowledge-intensive benchmarks show that FAITH improves the factual accuracy and truthfulness of Large Language Models (LLMs). |
DocMMIR: A Framework for Document Multi-modal Information Retrieval (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing multi-modal information retrieval models lack a comprehensive exploration of document-level retrieval . existing models suffer from the absence of cross-domain datasets at this granularity. |
| Approach: | They propose a multi-modal document retrieval framework to unify diverse document formats and domains with a comprehensive retrieval scenario. |
| Outcome: | The proposed framework improves document retrieval performance on a large multimodal dataset. |
GeezSwitch: Language Identification in Typologically Related Low-resourced East African Languages (2022.lrec-1)
Copied to clipboard
| Challenge: | Low-resourced languages with similar typologies are often confused with each other in real-world applications such as machine translation, affecting the user’s experience. |
| Approach: | They propose to build a dataset for five typologically and phylogenetically related low-resourced East African languages using the Ge’ez script as a writing system. |
| Outcome: | The proposed dataset is built automatically from selected data sources, but also performed a manual evaluation to assess its quality. |
Numbers Matter! Bringing Quantity-awareness to Retrieval Systems (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Quantitative information is important for understanding documents and interpreting them. |
| Approach: | They propose two quantity-aware ranking techniques that rank both quantity and textual content . they use available retrieval systems to incorporate quantity information into queries . |
| Outcome: | The proposed methods can rank both quantity and textual content, either jointly or independently. |
Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensive (2023.emnlp-main)
Copied to clipboard
Tharindu Weerasooriya, Sujan Dutta, Tharindu Ranasinghe, Marcos Zampieri, Christopher Homan, Ashiqur KhudaBukhsh
| Challenge: | a paper examines how machine and human moderators disagree on offensive speech . offensive speech detection is a key component of content moderation . |
| Approach: | They propose a large-scale noise audit and a vicarious offense dataset to investigate disagreement on social web political discourse. |
| Outcome: | The proposed dataset reveals that moderation outcomes vary wildly across different machine moderators. |
Interoperability of Language-related Information: Mapping the BLL Thesaurus to Lexvo and Glottolog (L18-1)
Copied to clipboard
| Challenge: | The Bibliography of Linguistic Literature (BLL Thesaurus) has been used since 2013 in the context of the Lin gu is tik portal, a hub for linguistically relevant information. |
| Approach: | They propose to use Lexvo and Glottolog to facilitate interoperability between the BLL Thesaurus and terminological repositories in the Linguistic Linked Open Data cloud. |
| Outcome: | The proposed model is based on Lexvo and Glottolog and is able to connect to the Linguistic Linked Open Data cloud. |
Text Classification Using Label Names Only: A Language Model Self-Training Approach (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current text classification methods require a large number of labeled documents as training data. |
| Approach: | They propose a model that uses only the label name of each class to train classification models on unlabeled data without using any labeled examples. |
| Outcome: | The proposed model achieves 90% accuracy on four benchmark datasets using label names as the only supervision . |
N24News: A New Dataset for Multimodal News Classification (2022.lrec-1)
Copied to clipboard
| Challenge: | Current news datasets focus on text features and rarely leverage the feature of images. |
| Approach: | They propose a news dataset that uses both images and text to achieve better news classification. |
| Outcome: | The proposed model improves on the existing dataset N24News with text and image information. |
Large-scale similarity search with Optimal Transport (2023.emnlp-main)
Copied to clipboard
| Challenge: | Word mover's distance (WMD) is a powerful tool for comparing probability distributions in NLP. |
| Approach: | They propose a waterstein distance approximation that uses the L1 embedding method to find the k-nearest neighbors. |
| Outcome: | The proposed approximation performs comparable to the vanilla Wasserstein distance and can be computed three orders of magnitude faster than the vanilla waterstein distance. |
Beyond Text: Leveraging Multi-Task Learning and Cognitive Appraisal Theory for Post-Purchase Intention Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that user-level features can carry more task-related information than the text itself. |
| Approach: | They evaluate multi-task learning frameworks grounded in Cognitive Appraisal Theory to predict user behavior as a function of users’ self-expression and psychological attributes. |
| Outcome: | The proposed models improve on the language and traits of users, while lacking rich annotations of other attributes. |
Simplified Graph Learning for Inductive Short Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for short text classification are limited and lack of labeled data is not enough. |
| Approach: | They propose a novel short text classification algorithm which leverages words to handle the lack of labeled data. |
| Outcome: | The proposed model performs better with lower memory consumption and faster inference speed than previous models. |
MemSearcher: Iterative Memory Integration for Search Agent via End-to-End Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Qianhao Yuan, Jie Lou, Zichao Li, Jiawei Chen, Yaojie Lu, Hongyu Lin, Le Sun, Debing Zhang, Xianpei Han
| Challenge: | Recent LLM-based search agents often concatenate the full interaction history into the context, producing long and noisy inputs and increasing compute cost and memory overhead. |
| Approach: | They propose an agent framework that maintains a compact memory during multi-turn interactions. |
| Outcome: | The proposed framework outperforms strong history-concatenation (ReAct-style) baselines on a range of public datasets while maintaining nearly constant token counts across multi-turn interactions. |
IL-PCSR: Legal Corpus for Prior Case and Statute Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for identifying/retrieving relevant statutes and prior cases/precedents are inherently related, e.g., similar cases tend to cite similar statutes due to similar factual situation. |
| Approach: | They propose a corpus that provides a common testbed for developing models that exploit the dependence between the two tasks. |
| Outcome: | The proposed corpus exploits the dependence between the two retrieval tasks and provides a baseline model for the two tasks. |
On Complementarity Objectives for Hybrid Retrieval (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to hybrid retrieval focus on sparse models to capture “residual” features neglected in spars. |
| Approach: | They propose a new objective to capture a fuller notion of complementarity . they propose to improve the model's Ratio of Complementarity to improve RoC . |
| Outcome: | The proposed method outperforms state-of-the-art methods on three representative IR benchmarks with statistical significance. |
HYRR: Hybrid Infused Reranking for Passage Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing passage retrieval systems typically adopt a two-stage retrieve-then-rerank pipeline. |
| Approach: | They propose a framework for training robust reranking models using hybrid retrievers . they propose HYRR framework that allows users to select training data using hybrids . |
| Outcome: | The proposed framework is robust to different first-stage retrieval settings. |
D2-RAG: Dual-Decision Retrieval-Augmented Generation via Multi-Dimensional Uncertainty and Utility-Aware Decoding (2026.findings-acl)
Copied to clipboard
Jinshuo Zhang, Xiaoding Zhou, Weiyu Zhang, Guoqiang Chen, Ying Lian, Xiaoyang Meng, Yonghe Chen, Hongjiao Guan, Jiasheng Si, Wenpeng Lu
| Challenge: | Retrieval-Augmented Generation (RAG) mitigates hallucinations in large language models by incorporating external knowledge. |
| Approach: | They propose a dual-decision retrieval-augmented generation that integrates multi-dimensional uncertainty estimation to decide whether to retrieve and employs adaptive contrastive decoding to handle retrieved contexts of varying quality. |
| Outcome: | The proposed model outperforms baselines on four medical question-answering datasets while suppressing interference from noisy contexts. |
A Multi-Perspective Architecture for Semantic Code Search (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models do not model interactions between code and description until the final step when their global similarity is calculated. |
| Approach: | They propose a multi-perspective cross-lingual neural framework for code–text matching that captures both global and local similarities. |
| Outcome: | The proposed model performs better on the CoNaLa dataset than previous approaches that map code and text to a single joint embedding space. |
What is the Real Intention behind this Question? Dataset Collection and Intention Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Using the Wikipedia discussions, we identified positive/neutral and negative intentions in questions . questions can also reflect implicit offenses such as highlighting one’s lack of knowledge or bolstering an alleged superior knowledge, which can lead to conflict in conversations. |
| Approach: | They propose to use a dataset to identify questions with positive/neutral and negative intentions and the underlying intention categories within each group to highlight tacit and apparent intents. |
| Outcome: | The proposed method highlights tacit and apparent intents and uses Transformers augmented by TF-IDF-based features to classify the main intention categories. |
Noisy Pair Corrector for Dense Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing dense retrieval models assume that query-document pairs are exactly matched, resulting in mismatched-pair noise. |
| Approach: | They propose a novel approach to train an effective model with mismatched-pair noise. |
| Outcome: | The proposed model performs well on natural question and triviaQA, code-search benchmarks and SO-DS. |
Enhancing Generative Retrieval with Reinforcement Learning from Relevance Feedback (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end generative retrieval models produce document identifiers in response to a query . however, this approach has two challenges: an overemphasis on top-1 results at the expense of overall ranking quality. |
| Approach: | They propose a generative retrieval model with reinforcement learning from relevance feedback to align token-level docid generation with document-level relevance estimation. |
| Outcome: | The proposed model aligns token-level docid generation with document-level relevance estimation. |
M3Retrieve: Benchmarking Multimodal Retrieval for Medicine (2025.emnlp-main)
Copied to clipboard
| Challenge: | Strong retrieval models are increasingly important in knowledge-intensive domains. |
| Approach: | They propose a benchmark to evaluate multimodal retrieval models in medical settings . they examine 1.2 million text documents and 164K multimodal queries . |
| Outcome: | The proposed model spans 5 domains,16 medical fields, and 4 distinct tasks with over 1.2 Million text documents and 164K multimodal queries. |
Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches for Multimodal Sentiment Analysis (MSA) rely on parameter-heavy LLMs for classification, overlooking multimodal sentiment reasoning generation in resource-limited environments. |
| Approach: | They propose a multimodal sentiment reasoning distillation model that employs a teacher-assistant-student paradigm to address deployment constraints in resource-limited environments. |
| Outcome: | The proposed model performs well on a resource-limited JMSRC task with only 3B parameters and shows generalization and interpretability. |
Dense Passage Retrieval: Is it Retrieving? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) internally store repositories of knowledge, but access to these repositoriels is imprecise. |
| Approach: | They propose a paradigm called retrieval augmented generation to address hallucinations . they analyze the role of fine-tuning pre-trained networks to enhance alignment . |
| Outcome: | The proposed paradigm addresses hallucinations by fine-tuning pre-trained models . the model can be decentralized, inject facts as decentralized representations . |
Lexical Tone Recognition in Mizo using Acoustic-Prosodic Features (2020.lrec-1)
Copied to clipboard
| Challenge: | Mizo is an under-studied Tibeto-Burman tonal language of the Northeast of India. |
| Approach: | They propose to use acoustic-prosodic parameters to automatically recognize four phonological tones in Mizo using a set of features computed from Fundamental Frequency contours. |
| Outcome: | The proposed model performs better than the existing classifiers in recognizing four phonological tones in Mizo using acoustic-prosodic parameters. |
PaperRegister: Boosting Flexible-grained Paper Search via Hierarchical Register Indexing (2026.acl-long)
Copied to clipboard
| Challenge: | Existing paper search systems lack detailed information to support finer-grained queries. |
| Approach: | They propose a paper-based index that transforms abstract-based corpus index into hierarchical index tree and offline can support paper search queries. |
| Outcome: | The proposed system achieves the SOTA performance and excels in fine-grained scenarios. |
LCR-RAG: Enhancing Logical Consistency in Retrieval-Augmented Generation via Neuro-symbolic Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge and improve factual accuracy. |
| Approach: | They propose a framework that integrates neuro-symbolic verification with reinforcement learning to optimize logical consistency. |
| Outcome: | The proposed framework outperforms strong RAG baselines on hotpotQA, ASQA, and TriviaQA. |
Structured Confidence–Guided Online Adaptation for LLM-based Multi-Label Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) enable zero-shot and few-shot multi-label text classification . but most approaches perform static inference and degrade under streaming test data . |
| Approach: | They propose a structured confidence-guided online adaptation framework for LLM-based multi-label generation without parameter updates. |
| Outcome: | The proposed framework improves Micro-F1 and Macro-F1, with the largest gains on long-tail labels. |
Efficient Layer-wise LLM Fine-tuning for Revision Intention Prediction (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have shown extraordinary success across text generation tasks . however, their potential for simple yet essential text classification remains underexplored . |
| Approach: | a plug-and-play layer-wise parameter-efficient fine-tuning framework is proposed . it fine- tunes a subset of important LLM layers while freezing redundant ones . |
| Outcome: | a plug-and-play framework fine-tunes a subset of important LLM layers while freezing redundant layers. |
Are Large Language Models Good Classifiers? A Study on Edit Intent Classification in Scientific Document Revisions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Generative large language models (LLMs) have brought advances in text generation, but their potential for enhancing classification tasks remains underexplored. |
| Approach: | They propose a framework for thoroughly investigating fine-tuning LLMs for classification . they instantiate this framework in edit intent classification (EIC) a challenging and underexplored classification task. |
| Outcome: | The proposed framework is applied to edit intent classification (EIC) The proposed methods are generalizable on five further classification tasks. |
Mandarin classifier systems optimize to accommodate communicative pressures (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies suggest that gendered languages are inherently optimized to accommodate communicative pressures on language learning and processing. |
| Approach: | They propose to use grammatical or probabilistic modifiers to smooth the entropy of nouns in context to find the same frequency, similarity, and co-occurrence interactions that structure gender systems. |
| Outcome: | The proposed noun classification device is sensitive to frequency, similarity, and co-occurrence interactions that structure gender systems. |
TRIAL: Token Relations and Importance Aware Late-interaction for Accurate Text Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Late-interaction based multi-vector retrieval systems rely on a naive summation of token-level similarity scores . this leads to inaccurate relevance estimation due to tokenization of semantic units and the influence of low-content words. |
| Approach: | They propose a late-interaction-based multi-vector retrieval system that uses token relations and token importance in relevance scoring. |
| Outcome: | Extensive tests show that TRIAL achieves state-of-the-art accuracy compared to existing methods. |
Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing retrieval-augmented generation methods are insufficient for multi-hop question answering . however, they tend to generate hallucinations due to semantic mismatching . |
| Approach: | They propose to optimize question semantic space for dynamic retrieval-augmented multi-hop question answering by optimizing the semantic embeddings. |
| Outcome: | The proposed method outperforms existing RAG methods in both in- and out-of-domain settings. |
Media Source Matters More Than Content: Unveiling Political Bias in LLM-Generated Citations (2025.emnlp-main)
Copied to clipboard
| Challenge: | generative search engines rely on in-line citations as the key gateway to original webpages . a recent study shows that LLMs tend to cite left-leaning sources at higher rates compared to traditional retrieval systems . |
| Approach: | They construct a dataset of news articles labeled with left- or right-leaning stances . they find that LLMs tend to cite left-leansing sources at higher rates than traditional retrieval systems . |
| Outcome: | The proposed dataset shows that LLMs tend to cite left-leaning sources at higher rates than traditional retrieval systems. |
Familiarity-Aware Evidence Compression for Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) improves large language models by incorporating non-parametric knowledge through evidence retrieved from external sources. |
| Approach: | They propose a training-free evidence compression technique that makes retrieved evidence more familiar to the target model while seamlessly integrating parametric knowledge from the model. |
| Outcome: | The proposed technique outperforms the most recent evidence compression baselines across open-domain QA datasets while achieving high compression rates. |
Hybrid and Collaborative Passage Reranking (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing solutions to passage reranking focus on enriching the interaction between query and each passage separately, neglecting the context among the top-ranked passages. |
| Approach: | They propose a Hybrid and Collaborative Passage Reranking method that leverages the similarity measurements of upstream retrievers for passage collaboration. |
| Outcome: | Experiments show that HybRank improves over existing methods and improves performance. |
Language Variety Identification with True Labels (2024.lrec-main)
Copied to clipboard
Marcos Zampieri, Kai North, Tommi Jauhiainen, Mariano Felice, Neha Kumari, Nishant Nair, Yash Mahesh Bangera
| Challenge: | Language identification datasets are compiled with the assumption that the gold label of each instance is determined by where texts are retrieved from. |
| Approach: | They present a human-annotated multilingual dataset for language variety identification . they use a model to train multiple models to discriminate between different languages . |
| Outcome: | The proposed dataset provides a reliable benchmark toward robust and fairer language variety identification systems. |
Diffusion Guided Language Modeling (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing guidance methods for text generation are prone to decoding errors and degrade performance. |
| Approach: | They propose a model that steers an auto-regressive language model to generate text with desired properties. |
| Outcome: | The proposed model outperforms existing guidance methods on a wide range of benchmark data sets. |
The Distracting Effect: Understanding Irrelevant Passages in RAG (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect and use hard distracting passages in RAG can cause problems . retrieved passages contain irrelevant but semantically related information that may mislead the LLM . |
| Approach: | They propose a method to identify and use hard distracting passages to improve RAG . they find that adding retrieved passages is found to ground the LLM response . |
| Outcome: | The proposed method achieves up to 7.5% increase in answering accuracy compared to fine-tuned datasets. |
Dynamic Injection of Entity Knowledge into Dense Retrievers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Dense retrievers struggle with queries involving less-frequent entities due to limited entity knowledge. |
| Approach: | They propose a BERT-based retriever enhanced with a context-entity attention layer and dynamically updatable entity embeddings. |
| Outcome: | The proposed retriever incorporates external entity knowledge without retraining. |
R^3AG: Retriever Routing for Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is often bottlenecked by the “one-size-fits-all” retrieval paradigm, as different queries exhibit distinct preferences for different retrievers. |
| Approach: | They propose a novel routing framework that explicitly models the dynamic alignment between queries and retriever capabilities and decomposes retriever capability into two learnable dimensions: retrieval quality and generation utility. |
| Outcome: | Experiments on knowledge-intensive tasks show that R3AG outperforms both the best individual retrievers and state-of-the-art static routing methods. |
FinEntity: Entity-level Sentiment Classification for Financial Texts (2023.emnlp-main)
Copied to clipboard
| Challenge: | FinEntity annotates financial entity spans and their sentiment (positive, neutral, and negative) in financial news. |
| Approach: | They introduce an entity-level sentiment classification dataset called FinEntity that annotates financial entity spans and their sentiment in financial news. |
| Outcome: | The proposed dataset annotates financial entity spans and their sentiment (positive, neutral, and negative) in financial news. |
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages (2023.findings-emnlp)
Copied to clipboard
Elena Ruzzetti, Federico Ranaldi, Felicia Logozzo, Michele Mastromattei, Leonardo Ranaldi, Fabio Zanzotto
| Challenge: | a recent study examined how models for typologically similar languages encode structural information. |
| Approach: | They propose to layer-wise compare transformers for typologically similar languages to observe similarities . they use a domain adaptation on semantically equivalent texts to measure similarity . |
| Outcome: | The proposed model outperforms all other models on unseen sentences . the proposed model is based on a typologically similar language . |
Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have demonstrated effectiveness in zero-shot retrieval tasks using large language models. |
| Approach: | They challenge this assumption by analyzing whether knowledge leakage in benchmarks contributes to performance gains. |
| Outcome: | The proposed methods have demonstrated significant performance gains across multiple benchmarks. |
Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs (2024.emnlp-main)
Copied to clipboard
Xin Zhou, Ping Nie, Yiwen Guo, Haojie Wei, Zhanqiu Zhang, Pasquale Minervini, Ruotian Ma, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing research seeks to enhance RAG performance by retrieving higher-quality documents or designing RAG-specific LLMs, but internal mechanisms that contribute to RAG’s effectiveness remain underexplored. |
| Approach: | They propose to examine the internal mechanisms within the popular Mixture-of-Expert (MoE)-based LLMs and examine their ability to improve RAG by examining expert activations. |
| Outcome: | The proposed method significantly improved the ability of Large Language Models (LLMs) to solve knowledge-intensive tasks. |
RACER: Retrieval-Augmented Contextual Rapid Speculative Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for decoding large language models generate one token per step, causing high inference latency. |
| Approach: | They propose a method that integrates retrieved exact patterns with logit-driven future cues. |
| Outcome: | Experiments on Spec-Bench, HumanEval, and MGSM-ZH show that RACER outperforms training-free methods and accelerates inference. |
Murre24: Dialect Identification of Finnish Internet Forum Messages (2024.lrec-main)
Copied to clipboard
| Challenge: | 94 million messages posted on the largest Finnish internet forum, Suomi24, are classified to present either the standard language, one of the seven traditional dialects, a colloquial style or the Helsinki slang. |
| Approach: | They present a collection of dialectal messages posted on the largest Finnish internet forum, Suomi24 . they manually annotated a dataset and used it to train dialect identification models . |
| Outcome: | The proposed method is the best for differentiating standard Finnish from non-standard Finnish, while fine-tuning a BERT-based model achieves best scores on the final dialect identification task. |
FlowRAG: Synergizing Explicit Reasoning via Frequency-Aware Multi-Granularity Graph Flow (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Graph-based retrieval-augmented generation rely on implicit semantic relevance propagation. |
| Approach: | They propose a semantic-aware retrieval framework that improves both semantic recall and explicit reasoning. |
| Outcome: | Extensive experiments show that FlowRAG improves both semantic recall and explicit reasoning. |
s3: You Don’t Need That Much Data to Train a Search Agent via RL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to optimize retrieval using search-only metrics ignore downstream utility and fine-tune entire LLM to jointly reason and retrieve limit retrieval utility and compatibility with frozen or proprietary models. |
| Approach: | They propose a lightweight, model-agnostic framework that decouples the searcher from the generator and trains the search user using a Gain Beyond RAG reward. |
| Outcome: | The proposed framework outperforms baselines trained on over 70 more data with 2.4k training samples. |
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks. |
| Approach: | They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges. |
| Outcome: | The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization. |
PIRB: A Comprehensive Benchmark of Polish Dense and Hybrid Text Retrieval Methods (2024.lrec-main)
Copied to clipboard
| Challenge: | PIRB is a framework for text information retrieval in Polish . existing and new datasets are evaluated to evaluate the performance of 41 models . |
| Approach: | They propose a framework for 41 text information retrieval tasks in Polish . they evaluate over 20 dense and sparse retrieval models and build sparser-dense hybrid retrievers . |
| Outcome: | The proposed framework outperforms the best available methods in 41 tasks for Polish . the proposed models outperformed the best solutions available to date . |
Improving Occupational ISCO Classification of Multilingual Swiss Job Postings with LLM-Refined Training Data (2025.findings-acl)
Copied to clipboard
| Challenge: | 80% of job postings are German, 11% French, 8% English, and under 1% Italian. |
| Approach: | They propose a method that refines silver-standard ISCO labels by consolidating them with predictions from pre-fine-tuned models to resolve discrepancies. |
| Outcome: | The proposed method raises Top-1 accuracy on silver data to 58.3% and reaches 80% precision on held-out data. |
TreeBoN: Enhancing Inference-Time Alignment with Speculative Tree-Search and Best-of-N Sampling (2025.findings-emnlp)
Copied to clipboard
Jiahao Qiu, Yifu Lu, Yifan Zeng, Jiacheng Guo, Jiayi Geng, Chenhao Zhu, Xinzhe Juan, Ling Yang, Huazheng Wang, Kaixuan Huang, Yue Wu, Mengdi Wang
| Challenge: | Best-of-N (BoN) sampling generates multiple responses and selects the best one, achieving improved performance but with a high computational cost. |
| Approach: | They propose a framework that integrates a speculative tree-search strategy into Best-of-N (BoN) Sampling. |
| Outcome: | The proposed framework outperforms Best-of-N (BoN) sampling but has high computational cost . tree-search strategy reduces computational overhead while maintaining high output quality . |
Context is Gold to find the Gold Passage: Evaluating and Training Contextual Document Embeddings (2025.emnlp-main)
Copied to clipboard
| Challenge: | Modern document retrieval embedding methods typically encode passages (chunks) from documents independently, often overlooking contextual information from the rest of the document. |
| Approach: | They propose a benchmark to evaluate retrieval models' ability to leverage document-wide context. |
| Outcome: | The proposed method significantly improves retrieval quality on ConTEB without sacrificing base model performance. |
MS-RAG: Simple and Effective Multi-Semantic Retrieval-Augmented Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for large language models suffer from poor indexing and inference speed . graph-based RAGs heavily rely on LLM for retrieval thus inference slow . |
| Approach: | They propose retrieval-augmented generation (RAG) which integrates knowledge with dense vectors to build a multi-semantic RAG. |
| Outcome: | The proposed method achieves state-of-the-art performance with faster inference speed compared to existing methods . |
CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG frameworks face critical limitations due to text chunking and semantic similarity. |
| Approach: | They propose a framework that incorporates causal graphs into the retrieval process. |
| Outcome: | The proposed framework preserves contextual continuity and improves retrieval precision, leading to more accurate and interpretable responses. |
Benchmarking Foundation Models with Retrieval-Augmented Generation in Olympic-Level Physics Problem Solving (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new study examines the potential of retrieval-augmented generation (RAG) with foundation models to enhance expert-level reasoning. |
| Approach: | They introduce PhoPile, a high-quality multimodal dataset specifically designed for Olympiad-level physics. |
| Outcome: | The proposed model can be used to solve Olympiad-level physics problems. |
RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have brought a great breakthrough to the natural language processing community, but their high throughput demands make them difficult to handle concurrent queries. |
| Approach: | They propose a parameter-efficient data multiplexing framework that integrates a reversible design in the multiplexer and can be reused to perform reverse operations and restore individual samples for classification. |
| Outcome: | The proposed framework improves inference efficiency while maintaining satisfactory classification performance. |
Beyond Generation: Leveraging LLM Creativity to Overcome Label Bias in Classification (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to mitigate label bias by leveraging in-domain data are often unavailable in real-world scenarios. |
| Approach: | They propose a calibration method that generates synthetic in-domain data from a few in-context demonstrations and utilizes it for calibration. |
| Outcome: | The proposed method reduces label bias by leveraging in-domain data from demonstrations. |
Equipping Retrieval-Augmented Large Language Models with Document Structure Awareness (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation ignore valuable structure that is crucial for document organization. |
| Approach: | They propose a framework that explicitly incorporates structural information throughout the RAG process. |
| Outcome: | The proposed framework incorporates structural information throughout the RAG process. |
TeClass: A Human-Annotated Relevance-based Headline Classification and Generation Dataset for Telugu (2024.lrec-main)
Copied to clipboard
| Challenge: | Relevance-based headline classification is under-explored in low-resource languages like Telugu due to a lack of annotated data. |
| Approach: | They propose that relevance-based headline classification can greatly aid the task of generating relevant headlines. |
| Outcome: | The proposed model can generate relevant headlines with 78,534 annotations in Telugu . the model shows a 5 point increment in the ROUGE-L scores . |
SACL: Understanding and Combating Textual Bias in Code Retrieval with Semantic-Augmented Reranking and Localization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that code retrievers exhibit a strong bias towards well-documented code . |
| Approach: | They propose a framework that augments textual information with semantic information to mask specific features while preserving code functionality. |
| Outcome: | The proposed framework enhances textual information and reduces bias by augmenting code or structural knowledge with semantic information. |
A Constrained Text Revision Agent via Iterative Planning and Searching (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing text revision systems are capable of generating fluent and coherent text, but struggle with constrained text revision (CTR). |
| Approach: | They propose a tool that generates revisions tailored to different scenarios using a planner, a reviser and adaptable tools. |
| Outcome: | The proposed agent outperforms baseline approaches in both constraint adherence and revision quality. |
The Open-World Lottery Ticket Hypothesis for OOD Intent Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods of Out-of-Domain intent classification lack confidence in In- and Out- of-domain intents. |
| Approach: | They propose to prune overparameterized models to provide better confidence . they extend the Lottery Ticket Hypothesis to open-world scenarios . |
| Outcome: | The proposed model can be calibrated to distinguish In- and Out-of-domain intents . the model can also improve on open-world scenarios . |
LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Yuxuan Li, Xinwei Guo, Jiashi Gao, Guanhua Chen, Xiangyu Zhao, Jiaxin Zhang, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei
| Challenge: | Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge. |
| Approach: | They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework . |
| Outcome: | The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text . |
Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Current reranking models are optimized on static human annotations in isolation, decoupled from the downstream generation process. |
| Approach: | They propose a reinforcement learning framework that directly aligns reranking with LLM's generation quality. |
| Outcome: | Experiments on knowledge-intensive benchmarks show that RRPO outperforms strong baselines. |
MM-StanceDet: Retrieval-Augmented Multi-modal Multi-agent Stance Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal stance detection face contextual grounding, cross-modal interpretation ambiguity, and single-pass reasoning fragility. |
| Approach: | They propose a multi-agent framework that integrates Retrieval Augmentation for contextual grounding, specialized Multimodal Analysis agents for nuanced interpretation, Reasoning-Enhanced Debate stage and Self-Reflection for robust adjudication. |
| Outcome: | Extensive experiments on five datasets show that the proposed framework outperforms state-of-the-art methods. |
Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization (2026.acl-long)
Copied to clipboard
Linfeng Du, Ye Yuan, Zichen Zhao, Fuyuan Lyu, Emiliano Penaloza, Xiuying Chen, Zipeng Sun, Jikun Kang, Laurent Charlin, Xue Liu, Haolun Wu
| Challenge: | Existing approaches for personalizing large language models require modifying parameters. |
| Approach: | They propose a lightweight approach to personalizing large language models via retrieval augmentation . relevance serves as an unreliable proxy for utility, they argue . |
| Outcome: | The proposed framework outperforms strong heuristic and retrieval-augmented baselines on nine personalization tasks. |
The Retrieval Bottleneck: Scaling Laws for Reinforcement Learning in RAG (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) has become the dominant paradigm for building knowledge-intensive language systems. |
| Approach: | They propose a sigmoidal scaling law that shows that retrieval quality determines the asymptotic performance ceiling. |
| Outcome: | The proposed model achieves strong performance on knowledge-intensive benchmarks while retaining the predictable scaling long available for pre-training but previously absent in RAG-RL. |
Cognitive-Uncertainty Guided Knowledge Distillation for Accurate Classification of Student Misconceptions (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for identifying student misconceptions overlook students' reasoning processes, authors report . |
| Approach: | They propose a knowledge distillation framework that mines high-value samples from existing data. |
| Outcome: | The proposed framework outperforms sota LLM and standard fine-tuned 72B models on cross-topic tests. |
Beyond Black-Box Interventions: Latent Probing for Faithful Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
Linfeng Gao, Qinggang Zhang, Baolong Bi, Bo Zeng, Zheng Yuan, Zerui Chen, Zhimin Wei, Shenghua Liu, Linlong Xu, Longyue Wang, Weihua Luo, Jinsong Su
| Challenge: | Existing approaches to improve contextual faithfulness treat the LLM as a black box, generating responses that are inconsistent with the provided context. |
| Approach: | They propose a framework for faithful RAG that operates in three stages: (i) fine-grained knowledge pruning to filter irrelevant context, (ii) latent conflict probing to identify hard conflicts in the model’s latent space, and (iv) conflict-aware attention to modulate attention heads toward faithful context integration. |
| Outcome: | Experiments show that ProbeRAG significantly improves both accuracy and contextual faithfulness. |
Validating and Exploring Large Geographic Corpora (2024.lrec-main)
Copied to clipboard
| Challenge: | a paper examines the impact of corpus creation decisions on multi-lingual web corpora . the goal is to understand the impact on downstream corporata with a focus on under-represented languages and populations. |
| Approach: | This paper evaluates the impact of corpus creation decisions on multi-lingual web corpora . three cleaning methods are used to improve the quality of sub-corpora in the common crawl . the goal is to understand the impact on downstream corporan with a focus on under-represented languages . |
| Outcome: | The results show that the validity of sub-corpora is improved with each stage of cleaning but that this improvement is unevenly distributed across languages and populations. |
RAG-on-a-Diet: A Reinforcement Learning-Based Dynamic Resource Optimization Framework for RAG (2026.acl-long)
Copied to clipboard
| Challenge: | Existing frameworks for knowledge-intensive multi-hop question answering do not adapt to how a trajectory unfolds. |
| Approach: | They propose a lightweight reinforcement-learning agent that treats each reasoning hop as an independent decision and selects the smallest model sufficient for it. |
| Outcome: | The proposed agent cuts Monetary Inference Cost by 60.07% against IRCoT with only a 3.7% F1 drop and matches Adaptive-RAG’s F1 at 37.30% lower cost. |
RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning (2025.emnlp-main)
Copied to clipboard
Yu Wang, Shiwan Zhao, Zhihu Wang, Ming Fan, Xicheng Zhang, Yubo Zhang, Zhengfan Wang, Heyuan Huang, Ting Liu
| Challenge: | Existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning. |
| Approach: | They introduce a module extension that integrates application-aware reasoning into the RAG pipeline. |
| Outcome: | Experiments show that RAG+ outperforms standard RAG variants and achieves gains of 3–5% in complex scenarios. |
Stronger Baselines for Retrieval-Augmented Generation with Long-Context Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing long-context language models (LMs) can handle tens of thousands of tokens in a single context window. |
| Approach: | They compare two recent multi-stage pipelines, ReadAgent and RAPTOR, against three baselines. |
| Outcome: | The proposed pipelines outperform more complex methods on multiple long-context QA benchmarks. |
microCLIP: Unsupervised CLIP Adaptation via Coarse-Fine Token Fusion for Fine-Grained Image Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing UA methods for fine-grained image classification rely on coarse-grain visual tokens, which misses fine spatial details. |
| Approach: | They propose a label-free self-training framework that adapts visual features and LLMderived text prototypes using fine-grained cues. |
| Outcome: | The proposed framework improves alignment between finegrained visual regions and rich textual descriptions while updating only layer norms and a tiny head. |
Evaluation Pitfalls and Sparsity Limitations in LLM-based Confidence Estimates for Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Xuan et al., 2023) show that verbalization produces extremely sparse outputs for confidence estimation. |
| Approach: | They propose to standardize stepwise interpolation for a fairer comparison . they advocate standardizing stepwise intercepts for AUARC evaluation . |
| Outcome: | The proposed method achieves the best AUARC score (+2.3 points over vanilla verbalization) while requiring less inference cost. |
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)
Copied to clipboard
Hongzhi Zhang, Yuanze Hu, Tinghai Zhang, Jia Fu, Tao Wang, Junwei Jing, Zhaoxin Fan, Wei Bi, Ruiming Tang, Han Li, Guorui Zhou, Kun Gai
| Challenge: | Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing. |
| Approach: | They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards. |
| Outcome: | The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations . |
RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation (2026.findings-acl)
Copied to clipboard
| Challenge: | Scientific rigour tends to be sidelined in favour of bold statements, leading authors to overstate claims beyond what their results support. |
| Approach: | They propose a multimodal framework that retrieves supporting evidence from a paper and assigns each claim an overstatement score. |
| Outcome: | The proposed framework retrieves supporting evidence from ICLR and NeurIPS papers and assigns each claim an overstatement score. |
Benchmarking Agentic Newswriting via Journalistic Workflows (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in autonomous digital agents highlight their potential for structured tasks through autonomous decision-making and task decomposition, but it remains unclear how well such systems support real-world information-intensive workflows. |
| Approach: | They propose a benchmark to evaluate how journalists can use agents to organize and organize information from the web. |
| Outcome: | The proposed system can be used to iterate and evaluate newswriting tasks in real-world situations. |
Structure Guided Retrieval-Augmented Generation for Factual Queries (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for RAG produce factually incorrect outputs, resulting in incorrect answers. |
| Approach: | They propose a novel problem that explicitly incorporates structural information into RAG for factual questions to satisfy all query conditions. |
| Outcome: | The proposed method significantly outperforms baselines on ERQA while maintaining reasonable computational overhead. |
Med-SRAF: A Multi-Agent Framework for Medical Reasoning via Semantic Routing and Agentic Fusion (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG methods suffer from a two-part problem: semantic drift and concatenation fallacy . et al.: rapid development of Large Language Models has led to a paradigm shift in artificial intelligence . |
| Approach: | They propose a multi-agent retrieval augmentation framework guided by medical domain knowledge to address these challenges. |
| Outcome: | The proposed framework outperforms existing general RAG baselines on five widely used medical benchmarks. |
A BERTology View of LLM Orchestrations: Token- and Layer-Selective Probes for Efficient Single-Pass Classification (2026.acl-long)
Copied to clipboard
| Challenge: | Modern LLM deployments are rarely a single model in isolation. |
| Approach: | They propose a model that reuses computation already paid for by the serving LLM . they instantiate a template with pooling, a scoring-attention gate, and a downcast multi-head self-attention probe . |
| Outcome: | The proposed model improves safety and sentiment benchmarks on dense and mixture-of-experts architectures while preserving near-serving latency. |
Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal aspect-based sentiment classification exploit discrete polarity patterns and generic visual embeddings. |
| Approach: | They propose a Valence–Arousal–Dominance(VAD)-Enhanced MABSC framework that integrates VAD signals into multimodal sentiment reasoning and learns emotion-sensitive image representations. |
| Outcome: | The proposed framework brings VAD signals into multimodal sentiment reasoning and learns emotion-sensitive image representations. |
HeteroCache: A Dynamic Retrieval Approach to Heterogeneous KV Cache Compression for Long-Context LLM Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Existing static compression methods suffer from coarse-grained caching and high I/O overhead. |
| Approach: | They propose a training-free dynamic compression framework that uses a sparse attention mechanism to categorize attention heads based on stability and similarity. |
| Outcome: | The proposed framework achieves state-of-the-art performance on long-context benchmarks and accelerates decoding by up to 3 compared to the original model with a 224K context. |
SMILE-Next: Teaching Large Language Models to Detect, Classify, and Reason about Laughter (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to understanding laughter or humor focus on narrowly defined tasks such as detecting humor and estimating humor intensity. |
| Approach: | They propose a dataset for real-world laughter understanding with multimodal textual representations and question–answer annotations. |
| Outcome: | The proposed framework outperforms baselines in three laughter-related tasks, showing that it is robust. |
Beyond Single-Shot: Multi-step Tool Retrieval via Query Planning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are evolving from text generation into integration within agentic workflows . tools such as APIs, databases, and software tools are expanding rapidly . |
| Approach: | They propose a lightweight framework that models retrieval as iterative query planning . instead of single-shot matching, ToolQP decomposes instructions into sub-tasks . |
| Outcome: | The proposed framework achieves state-of-the-art performance and robustness across retrievers. |
GRAD: Generalizing RAG Adaptation with Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Using GRAD, we can steer Retrieval-augmented generation objectives without retraining large language models. |
| Approach: | They propose an adaptive decoding-time framework that keeps the base generator fixed and composes small, objective-specific guidance at inference. |
| Outcome: | The proposed framework improves accuracy with favorable latency across public benchmarks and private settings with no in-domain labels while reliably activating helpful objectives and suppressing harmful ones, adaptively to tasks. |
Rethinking Retrieval-Augmented Generation as a Cooperative Decision-Making Problem (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RAG systems rely on ranking-centric, asymmetric dependency paradigms to generate results. |
| Approach: | They propose a framework that treats the reranker and the generator as peer decision-makers rather than being connected through an asymmetric dependency pipeline. |
| Outcome: | The proposed framework treats the reranker and the generator as peer decision-makers rather than being connected through an asymmetric dependency pipeline. |
SELECting over Tokens: Curating Pre-training Data at Scale via Token Classification (2026.acl-long)
Copied to clipboard
Xin Tong, Weidong Zhang, Jiaang Li, Haibin Chen, Shilei Liu, Langming Liu, Kangtao Lv, Yujin Yuan, Wenbo Su, Bo Zheng
| Challenge: | Existing pipelines rely on expert-crafted heuristic rules, which lack content-aware, fine-grained noise detection. |
| Approach: | They propose a framework that reframes data refinement as a highly efficient token classification task. |
| Outcome: | The proposed framework outperforms existing pipelines on benchmarks and is 2.5x faster at inference. |